Aug 28 08:35:20 devstack cinder-volume[74873]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 08:35:20 devstack cinder-volume[74873]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 08:35:20 devstack cinder-volume[74873]: we strongly recommend against using it for new projects. Aug 28 08:35:20 devstack cinder-volume[74873]: If you are already using Eventlet, we recommend migrating to a different Aug 28 08:35:20 devstack cinder-volume[74873]: framework. For more detail see Aug 28 08:35:20 devstack cinder-volume[74873]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 08:35:20 devstack cinder-volume[74873]: import eventlet # noqa Aug 28 08:35:23 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:35:23 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:35:23 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:35:24 devstack cinder-volume[74873]: INFO dbcounter [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Registered counter for database cinder Aug 28 08:35:24 devstack cinder-volume[74873]: DEBUG oslo_db.sqlalchemy.engines [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:35:24 devstack cinder-volume[74873]: DEBUG dbcounter [-] [74873] Writer thread running {{(pid=74873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:35:24 devstack cinder-volume[74873]: INFO cinder.rpc [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 08:35:24 devstack cinder-volume[74873]: INFO cinder.rpc [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_db.sqlalchemy.engines [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:35:25 devstack cinder-volume[74873]: INFO cinder.volume.manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Determined volume DB was empty at startup. Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG cinder.volume.manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74873) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 08:35:25 devstack cinder-volume[74873]: INFO cinder.volume.manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 08:35:25 devstack cinder-volume[74873]: WARNING stevedore.named [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 08:35:25 devstack cinder-volume[74873]: WARNING castellan.key_manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:35:25 devstack cinder-volume[74873]: WARNING cinder.keymgr.conf_key_mgr [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG cinder.volume.drivers.lvm [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74873) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_concurrency.processutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_concurrency.processutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=74873) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_db.sqlalchemy.engines [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:35:25 devstack cinder-volume[74873]: INFO cinder.rpc [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 28 08:35:25 devstack cinder-volume[74873]: INFO cinder.rpc [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 28 08:35:25 devstack cinder-volume[74873]: WARNING stevedore.named [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 08:35:25 devstack cinder-volume[74873]: WARNING castellan.key_manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:35:25 devstack cinder-volume[74873]: INFO cinder.volume.manager [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_db.sqlalchemy.engines [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74873) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:35:25 devstack cinder-volume[74873]: INFO oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Starting 1 workers Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Started child 75033 {{(pid=74873) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Full set of CONF: {{(pid=74873) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] ******************************************************************************** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Configuration options gathered from: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] ================================================================================ {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] allow_availability_zone_fallback = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] allow_compression_on_image_upload = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] allowed_direct_url_schemes = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] api_rate_limit = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] auth_strategy = keystone {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] az_cache_duration = 3600 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_availability_zone = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_host = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_stats_polling_interval = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backup_api_class = cinder.backup.api.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backup_name_template = backup-%s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backup_use_same_host = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backup_use_temp_snapshot = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] chap_password = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] chap_username = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_internal_tenant_project_id = e5beaf1a9f3f4e27adb9da9b70fe59a9 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_internal_tenant_user_id = 9ba828fd6dd34f42bbcaae4cc6f37db5 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cloned_volume_same_az = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cluster = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[75033]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] compression_format = gzip {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] compute_api_class = cinder.compute.nova.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] config_dir = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] config_source = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] control_exchange = openstack {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] debug = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] default_availability_zone = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] default_group_type = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] default_volume_type = lvmdriver-1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] disk_geometry = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_client_cert = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_client_cert_key = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_data_namespace = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_ssl_cert_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_ssl_cert_verify = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] driver_use_ssl = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] enable_force_upload = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] enable_new_services = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] enable_unsupported_driver = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] enforce_multipath_for_image_xfer = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] filter_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_api_insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_api_ssl_compression = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_ca_certificates_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_catalog_info = image:glance:publicURL {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_num_retries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance_request_timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] goodness_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] graceful_shutdown_timeout = 5 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] group_api_class = cinder.group.api.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] host = devstack {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_compress_on_upload = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_conversion_address_space_limit = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_conversion_cpu_limit = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_conversion_disable = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_upload_use_cinder_backend = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_upload_use_internal_tenant = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_volume_cache_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_volume_cache_max_count = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] image_volume_cache_max_size_gb = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] init_host_max_objects_retrieval = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] instance_format = [instance: %(uuid)s] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iscsi_target_flags = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iscsi_write_cache = on {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iser_helper = tgtadm {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iser_ip_address = 192.168.122.188 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iser_port = 3260 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_color = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_config_append = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_dir = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_options = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_rotate_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_rotate_interval_type = days {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] log_rotation_type = none {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] max_age = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] max_logfile_count = 30 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] max_logfile_size_mb = 200 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] max_over_subscription_ratio = 20.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] message_reap_interval = 86400 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] message_ttl = 2592000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] migration_create_volume_timeout_secs = 300 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] monkey_patch = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] monkey_patch_modules = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] my_ip = 192.168.122.188 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] no_snapshot_gb_quota = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] num_iser_scan_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] num_shell_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] num_volume_device_scan_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] nvmeof_conn_info_version = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] nvmet_ns_id = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] nvmet_port_id = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_max_limit = 1000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_ext_list = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_listen_port = 8776 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_use_ssl = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] osapi_volume_workers = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] per_volume_size_limit = -1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] periodic_fuzzy_delay = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] periodic_interval = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] public_endpoint = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] publish_errors = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_backup_gigabytes = 1000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_backups = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_gigabytes = 1000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_groups = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_snapshots = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] quota_volumes = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] rate_limit_burst = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] rate_limit_except_level = CRITICAL {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] rate_limit_interval = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] reinit_driver_count = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] replication_device = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] report_discard_supported = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] report_interval = 120 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] reservation_clean_interval = 86400 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] reservation_expire = 86400 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] reserved_image_namespaces = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] reserved_percentage = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] rpc_response_timeout = 120 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] run_external_periodic_tasks = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] scst_target_driver = iscsi {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] scst_target_iqn_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_down_time = 720 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] shell_completion = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] snapshot_name_template = snapshot-%s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] snapshot_same_host = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] split_loggers = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] state_path = /opt/stack/data/cinder {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] storage_availability_zone = nova {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] storage_protocol = iSCSI {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] syslog_log_facility = LOG_USER {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_helper = lioadm {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_ip_address = 192.168.122.188 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_port = 3260 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_protocol = iscsi {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] target_secondary_ip_addresses = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] trace_flags = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] transport_url = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] until_refresh = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_chap_auth = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_default_quota_class = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_journal = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_json = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_multipath_for_image_xfer = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_stderr = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] use_syslog = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] verify_glance_signatures = enabled {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_api_class = cinder.volume.api.API {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_backend_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_clear = zero {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_clear_ionice = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_clear_size = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[75033]: INFO cinder.volume.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 28 08:35:25 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_copy_bps_limit = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_dd_blocksize = 1M {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_name_template = volume-%s {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_service_inithost_offload = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volume_usage_audit_period = month {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] zoning_mode = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_concurrency.disable_process_locking = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.auth_section = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.auth_type = password {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.auth_version = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.cache = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.include_service_catalog = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.interface = public {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_password = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcache_username = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.region_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.service_type = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.backend = dogpile.cache.null {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.backend_argument = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.backend_expiration_time = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.config_prefix = cache.oslo {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.debug_cache_backend = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.enable_retry_client = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.enable_socket_keepalive = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.expiration_time = 600 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.hashclient_retry_attempts = 2 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_dead_retry = 300 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_pool_maxsize = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_sasl_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.password = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.proxies = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.redis_db = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.redis_server = localhost:6379 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.retry_attempts = 2 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.retry_delay = 0.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.socket_keepalive_count = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.socket_keepalive_idle = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.socket_keepalive_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.socket_timeout = 1.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.tls_allowed_ciphers = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.tls_cafile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.tls_certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.tls_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.tls_keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cache.username = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] coordination.backend_url = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.asyncio_connection = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.asyncio_slave_connection = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.backend = sqlalchemy {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.connection = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.connection_debug = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.connection_parameters = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.connection_recycle_time = 3600 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.connection_trace = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.db_inc_retry_interval = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.db_max_retries = 20 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.db_max_retry_interval = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.db_retry_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.max_overflow = 50 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.max_pool_size = 5 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:25 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.max_retries = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.mysql_wsrep_sync_wait = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.pool_timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.retry_interval = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.slave_connection = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.sqlite_synchronous = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.synchronous_reader = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] database.use_db_reconnect = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_tracing.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.connection_string = messaging:// {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.es_doc_type = notification {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.es_scroll_size = 10000 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.es_scroll_time = 2m {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.filter_error_trace = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.hmac_keys = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.sentinel_service_name = mymaster {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack sudo[75037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.socket_timeout = 0.1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.trace_requests = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler.trace_sqlalchemy = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler_jaeger.process_tags = {} {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler_jaeger.service_name_prefix = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] profiler_otlp.service_name_prefix = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.enforce_new_defaults = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack sudo[75037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.policy_default_rule = default {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.policy_file = policy.yaml {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.group = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.helper_command = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] privsep_osbrick.user = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.group = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.helper_command = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] cinder_sys_admin.user = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.auth_section = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.auth_type = password {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.cafile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.collect_timing = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.send_service_user_token = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.split_loggers = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] service_user.timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.auth_section = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.auth_type = password {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.collect_timing = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.region_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.split_loggers = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] glance.timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.backend_availability_zone = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.chap_password = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.chap_username = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.disk_geometry = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_client_cert = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_client_cert_key = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_data_namespace = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.driver_use_ssl = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.extra_capabilities = {} {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.filter_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.goodness_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iscsi_target_flags = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iscsi_write_cache = on {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iser_helper = tgtadm {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iser_port = 3260 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.lvm_share_target = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.lvm_type = auto {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.num_shell_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.replication_device = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.report_discard_supported = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.reserved_percentage = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_helper = tgtadm {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_port = 3260 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_protocol = iscsi {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.trace_flags = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.unique_fqdn_network = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.use_chap_auth = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_backend_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_clear = zero {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_clear_ionice = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_clear_size = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_reports.file_event_handler = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_reports.log_dir = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.backend_host = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.chap_password = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.chap_username = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.disk_geometry = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_client_cert = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.extra_capabilities = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.filter_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.goodness_function = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iser_helper = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iser_ip_address = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iser_port = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.lvm_share_target = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.lvm_type = auto {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.num_shell_tries = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.replication_device = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.report_discard_supported = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.reserved_percentage = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.scst_target_driver = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.storage_protocol = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_helper = lioadm {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_ip_address = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_port = 3260 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.trace_flags = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.use_chap_auth = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_clear = zero {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_clear_size = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] lvmdriver-1.volumes_dir = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_notifications.driver = [] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_notifications.retry = -1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] key_manager.fixed_key = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.barbican_api_version = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.barbican_endpoint = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.barbican_endpoint_type = public {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.barbican_region_name = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.cafile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.collect_timing = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.number_of_retries = 60 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.retry_delay = 1 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.send_service_user_token = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.split_loggers = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.verify_ssl = True {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican.verify_ssl_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.auth_section = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.auth_type = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.cafile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.certfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.collect_timing = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.insecure = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.keyfile = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.split_loggers = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] barbican_service_user.timeout = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.approle_role_id = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.approle_secret_id = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.auth_method = approle {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.auth_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.kv_mountpoint = secret {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.kv_path = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.kv_version = 2 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.namespace = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.root_token_id = **** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.ssl_ca_crt_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.timeout = 60.0 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.token_file = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.token_role = None {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.use_ssl = False {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:35:26 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] ******************************************************************************** {{(pid=74873) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 08:35:26 devstack sudo[75037]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:26 devstack sudo[75053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:26 devstack sudo[75053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:26 devstack sudo[75053]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.299s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:35:26 devstack cinder-volume[75033]: INFO cinder.brick.local_dev.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:26 devstack sudo[75223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:26 devstack sudo[75223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:26 devstack sudo[75223]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG cinder.brick.local_dev.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75033) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 28 08:35:26 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:26 devstack sudo[75295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:26 devstack sudo[75295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:27 devstack sudo[75295]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:27 devstack sudo[75504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:27 devstack sudo[75504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:27 devstack sudo[75504]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:27 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:27 devstack sudo[75642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 28 08:35:27 devstack sudo[75642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:28 devstack sudo[75642]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:28 devstack sudo[75653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:28 devstack sudo[75653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:28 devstack sudo[75653]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:28 devstack sudo[75711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:28 devstack sudo[75711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:28 devstack sudo[75711]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:28 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:28 devstack sudo[75739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:28 devstack sudo[75739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:29 devstack sudo[75739]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack sudo[75765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:29 devstack sudo[75765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:29 devstack sudo[75765]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack sudo[75832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:29 devstack sudo[75832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:29 devstack sudo[75832]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: INFO cinder.volume.drivers.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack sudo[75836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:29 devstack sudo[75836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:29 devstack sudo[75836]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:35:29 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:29 devstack sudo[75845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:29 devstack sudo[75845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:30 devstack sudo[75845]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:30 devstack sudo[75848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:30 devstack sudo[75848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:30 devstack sudo[75848]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:30 devstack sudo[75851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:30 devstack sudo[75851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:30 devstack sudo[75851]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:30 devstack sudo[75854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:30 devstack sudo[75854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:30 devstack sudo[75854]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:30 devstack cinder-volume[75033]: INFO cinder.volume.driver [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 08:35:30 devstack cinder-volume[75033]: DEBUG cinder.volume.driver [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75033) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_db.sqlalchemy.engines [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writer thread running {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG cinder.db.api [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Building query based on filter {{(pid=75033) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG cinder.image.image_utils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75033) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 08:35:31 devstack cinder-volume[75033]: INFO cinder.keymgr.migration [None req-dc322870-2c73-4cb7-ad20-5373ac3b1773 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:31 devstack sudo[75857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:31 devstack sudo[75857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:31 devstack sudo[75857]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:31 devstack sudo[75862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:31 devstack sudo[75862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:31 devstack sudo[75862]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:31 devstack sudo[75865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:31 devstack sudo[75865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:31 devstack sudo[75865]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:31 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:31 devstack sudo[75868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:31 devstack sudo[75868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:32 devstack sudo[75868]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG cinder.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Notifying Schedulers of capabilities ... {{(pid=75033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:35:32 devstack cinder-volume[75033]: INFO cinder.volume.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Driver initialization completed successfully. Aug 28 08:35:32 devstack cinder-volume[75033]: INFO cinder.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Initiating service 2 cleanup Aug 28 08:35:32 devstack cinder-volume[75033]: INFO cinder.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Service 2 cleanup completed. Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG cinder.service [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Creating RPC server for service cinder-volume {{(pid=75033) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG cinder.service [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75033) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 08:35:32 devstack cinder-volume[75033]: INFO cinder.volume.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:32 devstack sudo[75872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:35:32 devstack sudo[75872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:32 devstack sudo[75872]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:32 devstack sudo[75877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:32 devstack sudo[75877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:32 devstack sudo[75877]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:32 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:33 devstack sudo[75880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:35:33 devstack sudo[75880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:33 devstack sudo[75880]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:33 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:33 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:35:33 devstack sudo[75886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:35:33 devstack sudo[75886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:35:33 devstack sudo[75886]: pam_unix(sudo:session): session closed for user root Aug 28 08:35:33 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:35:33 devstack cinder-volume[75033]: INFO cinder.volume.manager [None req-1dfbdce9-bb5d-4989-9063-05ad781e4c10 None None] Driver post RPC initialization completed successfully. Aug 28 08:35:35 devstack cinder-volume[74873]: DEBUG dbcounter [-] [74873] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74873) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:35:42 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writing DB stats cinder:SELECT=3 {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:35:43 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:36:00 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager._thread_info {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:36:00 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread count: 6 {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:36:00 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread info: [<_MainThread(MainThread, started 133225342206080)>, , , , , ] {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:37:00 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:37:00 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-df695b77-fa67-413a-833d-206205699395 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:37:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:37:00 devstack sudo[78520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:37:00 devstack sudo[78520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:37:00 devstack sudo[78520]: pam_unix(sudo:session): session closed for user root Aug 28 08:37:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:37:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:37:00 devstack sudo[78523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:37:00 devstack sudo[78523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:37:01 devstack sudo[78523]: pam_unix(sudo:session): session closed for user root Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:37:01 devstack sudo[78529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:37:01 devstack sudo[78529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:37:01 devstack sudo[78529]: pam_unix(sudo:session): session closed for user root Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:37:01 devstack sudo[78532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:37:01 devstack sudo[78532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:37:01 devstack sudo[78532]: pam_unix(sudo:session): session closed for user root Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG cinder.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] Notifying Schedulers of capabilities ... {{(pid=75033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager._thread_info {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread count: 6 {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:37:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread info: [<_MainThread(MainThread, started 133225342206080)>, , , , , ] {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:37:43 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writing DB stats cinder:SELECT=1 {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:37:43 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writing DB stats cinder:UPDATE=1 {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:38:00 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:38:00 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-df695b77-fa67-413a-833d-206205699395 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:38:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:38:00 devstack sudo[82139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:38:00 devstack sudo[82139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:38:00 devstack sudo[82139]: pam_unix(sudo:session): session closed for user root Aug 28 08:38:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:38:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:38:00 devstack sudo[82170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:38:00 devstack sudo[82170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:38:01 devstack sudo[82170]: pam_unix(sudo:session): session closed for user root Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:38:01 devstack sudo[82189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:38:01 devstack sudo[82189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:38:01 devstack sudo[82189]: pam_unix(sudo:session): session closed for user root Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:38:01 devstack sudo[82233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:38:01 devstack sudo[82233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:38:01 devstack sudo[82233]: pam_unix(sudo:session): session closed for user root Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG cinder.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] Notifying Schedulers of capabilities ... {{(pid=75033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager._thread_info {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread count: 6 {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:38:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread info: [<_MainThread(MainThread, started 133225342206080)>, , , , , ] {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:39:00 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:39:00 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-df695b77-fa67-413a-833d-206205699395 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:39:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:39:00 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:39:00 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:39:00 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Aug 28 08:39:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:39:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:39:00 devstack sudo[83790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:39:00 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:39:01 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:39:01 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:39:01 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:39:01 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:39:01 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:39:01 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:39:01 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG cinder.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] Notifying Schedulers of capabilities ... {{(pid=75033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager._thread_info {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread count: 6 {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:39:01 devstack cinder-volume[75033]: DEBUG cinder.volume.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] thread info: [<_MainThread(MainThread, started 133225342206080)>, , , , , ] {{(pid=75033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:39:43 devstack cinder-volume[75033]: DEBUG dbcounter [-] [75033] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:39:59 devstack cinder-volume[74873]: INFO oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Caught SIGTERM, stopping children Aug 28 08:39:59 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Acquiring lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:39:59 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Acquired lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:39:59 devstack cinder-volume[74873]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Releasing lock "singleton_lock" {{(pid=74873) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:39:59 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Stop services. {{(pid=74873) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 08:39:59 devstack cinder-volume[74873]: DEBUG oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Killing children. {{(pid=74873) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 08:39:59 devstack cinder-volume[74873]: INFO oslo_service.backend._eventlet.service [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Waiting on 1 children to exit Aug 28 08:40:00 devstack cinder-volume[75033]: DEBUG oslo_service.periodic_task [None req-df695b77-fa67-413a-833d-206205699395 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:40:00 devstack cinder-volume[75033]: DEBUG cinder.volume.drivers.lvm [None req-df695b77-fa67-413a-833d-206205699395 None None] Updating volume stats {{(pid=75033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 08:40:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:00 devstack sudo[84982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 08:40:00 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:00 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:00 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:00 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:40:00 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:01 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:01 devstack sudo[84988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 08:40:01 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:01 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:01 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 08:40:01 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:01 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG oslo_concurrency.processutils [None req-df695b77-fa67-413a-833d-206205699395 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:01 devstack cinder-volume[75033]: DEBUG cinder.manager [None req-df695b77-fa67-413a-833d-206205699395 None None] Notifying Schedulers of capabilities ... {{(pid=75033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:40:04 devstack cinder-volume[75033]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 28 08:40:04 devstack cinder-volume[84997]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 08:40:04 devstack cinder-volume[84997]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 08:40:04 devstack cinder-volume[84997]: we strongly recommend against using it for new projects. Aug 28 08:40:04 devstack cinder-volume[84997]: If you are already using Eventlet, we recommend migrating to a different Aug 28 08:40:04 devstack cinder-volume[84997]: framework. For more detail see Aug 28 08:40:04 devstack cinder-volume[84997]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 08:40:04 devstack cinder-volume[84997]: import eventlet # noqa Aug 28 08:40:06 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:40:06 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:40:06 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:40:07 devstack cinder-volume[84997]: INFO dbcounter [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Registered counter for database cinder Aug 28 08:40:07 devstack cinder-volume[84997]: DEBUG oslo_db.sqlalchemy.engines [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:07 devstack cinder-volume[75033]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Acquiring lock "singleton_lock" {{(pid=75033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:40:07 devstack cinder-volume[75033]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Acquired lock "singleton_lock" {{(pid=75033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:40:07 devstack cinder-volume[75033]: DEBUG oslo_concurrency.lockutils [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Releasing lock "singleton_lock" {{(pid=75033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:40:07 devstack cinder-volume[75033]: WARNING amqp [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 08:40:07 devstack cinder-volume[75033]: WARNING amqp [None req-702c9bd3-8763-454b-8aeb-2092aa394892 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 08:40:07 devstack cinder-volume[84997]: DEBUG dbcounter [-] [84997] Writer thread running {{(pid=84997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:40:07 devstack cinder-volume[84997]: INFO cinder.rpc [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 08:40:07 devstack cinder-volume[84997]: INFO cinder.rpc [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 08:40:07 devstack cinder-volume[84997]: DEBUG oslo_db.sqlalchemy.engines [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:07 devstack cinder-volume[84997]: INFO cinder.volume.manager [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Determined volume DB was empty at startup. Aug 28 08:40:07 devstack cinder-volume[84997]: DEBUG cinder.volume.manager [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84997) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 08:40:08 devstack cinder-volume[84997]: INFO cinder.volume.manager [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 08:40:08 devstack cinder-volume[84997]: WARNING stevedore.named [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 08:40:08 devstack cinder-volume[84997]: WARNING castellan.key_manager [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:40:08 devstack cinder-volume[84997]: WARNING cinder.keymgr.conf_key_mgr [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:40:08 devstack cinder-volume[84997]: INFO cinder.volume.manager [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_db.sqlalchemy.engines [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:08 devstack cinder-volume[84997]: INFO oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Starting 1 workers Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Started child 85249 {{(pid=84997) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Full set of CONF: {{(pid=84997) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] ******************************************************************************** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Configuration options gathered from: {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] ================================================================================ {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] allow_availability_zone_fallback = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] allow_compression_on_image_upload = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] allowed_direct_url_schemes = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] api_rate_limit = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] auth_strategy = keystone {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_availability_zone = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[85249]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_host = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_stats_polling_interval = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backup_api_class = cinder.backup.api.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backup_name_template = backup-%s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backup_use_same_host = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backup_use_temp_snapshot = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] chap_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] chap_username = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_internal_tenant_project_id = e5beaf1a9f3f4e27adb9da9b70fe59a9 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_internal_tenant_user_id = 9ba828fd6dd34f42bbcaae4cc6f37db5 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cluster = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] compression_format = gzip {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] compute_api_class = cinder.compute.nova.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] config_dir = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] config_source = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] control_exchange = openstack {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] debug = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] default_availability_zone = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] default_group_type = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] default_volume_type = QuobyteHD {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] disk_geometry = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_client_cert = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_client_cert_key = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_data_namespace = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_ssl_cert_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_ssl_cert_verify = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] driver_use_ssl = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] enable_new_services = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] enable_unsupported_driver = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] enabled_backends = ['QuobyteHD'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] enforce_multipath_for_image_xfer = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] filter_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_api_insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_api_ssl_compression = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_ca_certificates_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_catalog_info = image:glance:publicURL {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_num_retries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance_request_timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] goodness_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] graceful_shutdown_timeout = 5 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] group_api_class = cinder.group.api.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] host = devstack {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_compress_on_upload = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_conversion_address_space_limit = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_conversion_cpu_limit = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_conversion_disable = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_upload_use_cinder_backend = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_upload_use_internal_tenant = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_volume_cache_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_volume_cache_max_count = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] image_volume_cache_max_size_gb = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] init_host_max_objects_retrieval = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] instance_format = [instance: %(uuid)s] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iscsi_target_flags = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iscsi_write_cache = on {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iser_helper = tgtadm {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iser_ip_address = 192.168.122.188 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iser_port = 3260 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_color = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_config_append = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_dir = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_options = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_rotate_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_rotate_interval_type = days {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] log_rotation_type = none {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[85249]: INFO cinder.volume.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.remotefs [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85249) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] max_age = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] max_logfile_count = 30 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] max_logfile_size_mb = 200 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] max_over_subscription_ratio = 20.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] message_reap_interval = 86400 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] message_ttl = 2592000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] migration_create_volume_timeout_secs = 300 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] monkey_patch = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] monkey_patch_modules = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] my_ip = 192.168.122.188 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] no_snapshot_gb_quota = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] num_iser_scan_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] num_shell_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] num_volume_device_scan_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] nvmeof_conn_info_version = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] nvmet_ns_id = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] nvmet_port_id = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_max_limit = 1000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_ext_list = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_listen_port = 8776 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_use_ssl = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] osapi_volume_workers = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] per_volume_size_limit = -1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] periodic_fuzzy_delay = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] periodic_interval = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] public_endpoint = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] publish_errors = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_backup_gigabytes = 1000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_backups = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_gigabytes = 1000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_groups = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_snapshots = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] quota_volumes = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] rate_limit_burst = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] rate_limit_except_level = CRITICAL {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] rate_limit_interval = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] reinit_driver_count = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] replication_device = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] report_discard_supported = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] report_interval = 120 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] reservation_clean_interval = 86400 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] reservation_expire = 86400 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] reserved_image_namespaces = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] reserved_percentage = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] rpc_response_timeout = 120 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] run_external_periodic_tasks = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] scst_target_driver = iscsi {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] scst_target_iqn_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_down_time = 720 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] shell_completion = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] snapshot_name_template = snapshot-%s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] split_loggers = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] state_path = /opt/stack/data/cinder {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] storage_availability_zone = nova {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] storage_protocol = iSCSI {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] syslog_log_facility = LOG_USER {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_helper = lioadm {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_ip_address = 192.168.122.188 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_port = 3260 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_protocol = iscsi {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] target_secondary_ip_addresses = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] trace_flags = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] transport_url = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] until_refresh = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_chap_auth = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_default_quota_class = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_journal = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_json = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_multipath_for_image_xfer = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_stderr = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] use_syslog = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] verify_glance_signatures = enabled {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_api_class = cinder.volume.api.API {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_backend_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_clear = zero {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_clear_ionice = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_clear_size = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_copy_bps_limit = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_dd_blocksize = 1M {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_name_template = volume-%s {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_service_inithost_offload = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volume_usage_audit_period = month {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] zoning_mode = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_concurrency.disable_process_locking = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.auth_section = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.auth_type = password {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.auth_version = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.cache = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.include_service_catalog = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.interface = public {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcache_username = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.region_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.service_type = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85249) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 08:40:08 devstack cinder-volume[85249]: WARNING cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 08:40:08 devstack cinder-volume[85249]: WARNING cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Running cmd (subprocess): mount.quobyte {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.backend = dogpile.cache.null {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.backend_argument = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.backend_expiration_time = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.config_prefix = cache.oslo {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.debug_cache_backend = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.enable_retry_client = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.enable_socket_keepalive = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.expiration_time = 600 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.hashclient_retry_attempts = 2 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_dead_retry = 300 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_pool_maxsize = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_sasl_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.proxies = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.redis_db = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.redis_server = localhost:6379 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.retry_attempts = 2 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.retry_delay = 0.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.socket_keepalive_count = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.socket_keepalive_idle = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.socket_keepalive_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.socket_timeout = 1.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.tls_allowed_ciphers = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.tls_cafile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.tls_certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.tls_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.tls_keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cache.username = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] coordination.backend_url = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.asyncio_connection = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.asyncio_slave_connection = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.backend = sqlalchemy {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.connection = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.connection_debug = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.connection_parameters = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.connection_recycle_time = 3600 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.connection_trace = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.db_inc_retry_interval = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.db_max_retries = 20 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.db_max_retry_interval = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.db_retry_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.max_overflow = 50 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.max_pool_size = 5 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.max_retries = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.mysql_wsrep_sync_wait = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.pool_timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.retry_interval = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.slave_connection = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.sqlite_synchronous = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.synchronous_reader = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] database.use_db_reconnect = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_tracing.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.connection_string = messaging:// {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.es_doc_type = notification {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.es_scroll_size = 10000 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.es_scroll_time = 2m {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.filter_error_trace = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.hmac_keys = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.sentinel_service_name = mymaster {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.socket_timeout = 0.1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.trace_requests = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler.trace_sqlalchemy = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler_jaeger.process_tags = {} {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler_jaeger.service_name_prefix = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] profiler_otlp.service_name_prefix = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.enforce_new_defaults = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.policy_default_rule = default {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.policy_file = policy.yaml {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.group = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.helper_command = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] privsep_osbrick.user = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.group = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.helper_command = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] cinder_sys_admin.user = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.auth_section = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.auth_type = password {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.cafile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.collect_timing = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.send_service_user_token = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.split_loggers = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] service_user.timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.auth_section = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.auth_type = password {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.collect_timing = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.region_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.split_loggers = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] glance.timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.backend_availability_zone = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.chap_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.chap_username = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.disk_geometry = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_client_cert = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_client_cert_key = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_data_namespace = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.driver_use_ssl = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.extra_capabilities = {} {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.filter_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.goodness_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iscsi_target_flags = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iscsi_write_cache = on {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iser_helper = tgtadm {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iser_port = 3260 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_host = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_login = admin {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_mount_options = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_private_key = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_share_path = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack quobyte-client[85257]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.num_shell_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack quobyte-client[85257]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[85249]: INFO cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 ... Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.quobyte_volume_url = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.replication_device = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b -c /etc/quobyte/client-cinder.cfg {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.report_discard_supported = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.reserved_percentage = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_helper = tgtadm {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_port = 3260 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_protocol = iscsi {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.trace_flags = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.unique_fqdn_network = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.use_chap_auth = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_backend_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_clear = zero {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_clear_ionice = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_clear_size = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_reports.file_event_handler = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_reports.log_dir = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.backend_availability_zone = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.backend_host = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.chap_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.chap_username = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.chiscsi_conf = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.disk_geometry = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_client_cert = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_data_namespace = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.driver_use_ssl = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.extra_capabilities = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.filter_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.goodness_function = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iser_helper = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iser_ip_address = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iser_port = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.iser_target_prefix = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_host = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_login = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_mount_options = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_password = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_private_key = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_share_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_ssh_port = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.num_shell_tries = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b -c /etc/quobyte/client-cinder.cfg Aug 28 08:40:08 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.nvmet_port_id = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.replication_device = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.report_discard_supported = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.reserved_percentage = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.scst_target_driver = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.storage_protocol = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_helper = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_ip_address = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_port = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_prefix = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_protocol = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.trace_flags = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.use_chap_auth = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_clear = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_clear_size = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] QuobyteHD.volumes_dir = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_notifications.driver = [] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_notifications.retry = -1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] key_manager.fixed_key = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.barbican_api_version = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.barbican_endpoint = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.barbican_endpoint_type = public {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.barbican_region_name = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.cafile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.collect_timing = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.number_of_retries = 60 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.retry_delay = 1 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.send_service_user_token = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.split_loggers = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.verify_ssl = True {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican.verify_ssl_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.auth_section = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.auth_type = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.cafile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.certfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.collect_timing = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.insecure = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.keyfile = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.split_loggers = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] barbican_service_user.timeout = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.approle_role_id = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.approle_secret_id = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.auth_method = approle {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.auth_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.kv_mountpoint = secret {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.kv_path = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.kv_version = 2 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.namespace = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.root_token_id = **** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.ssl_ca_crt_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.timeout = 60.0 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.token_file = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.token_role = None {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.use_ssl = False {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:08 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] ******************************************************************************** {{(pid=84997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 08:40:08 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:08 devstack cinder-volume[85249]: INFO cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 succeeded Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.435s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:08 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:08 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:08 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:09 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.247s {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.volume.driver [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.volume.driver [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6149673461914, 'free_capacity_gb': 1774.6149673461914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85249) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_db.sqlalchemy.engines [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85249) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG dbcounter [-] [85249] Writer thread running {{(pid=85249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.db.api [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Building query based on filter {{(pid=85249) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.image.image_utils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85249) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.keymgr.migration [None req-4c3875e5-8a92-47df-b92b-7152266efddf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:09 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:09 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:09 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.229s {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Notifying Schedulers of capabilities ... {{(pid=85249) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.volume.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Driver initialization completed successfully. Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Initiating service 3 cleanup Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Service 3 cleanup completed. Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.service [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Creating RPC server for service cinder-volume {{(pid=85249) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.service [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85249) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 08:40:09 devstack cinder-volume[85249]: INFO cinder.volume.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85249) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG cinder.volume.drivers.quobyte [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85249) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85249) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:09 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:09 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:09 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:10 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:10 devstack cinder-volume[85249]: DEBUG oslo_concurrency.processutils [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.261s {{(pid=85249) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:10 devstack cinder-volume[85249]: INFO cinder.volume.manager [None req-7c86d1c3-329c-437f-bb04-897a64f1a1a3 None None] Driver post RPC initialization completed successfully. Aug 28 08:40:13 devstack cinder-volume[84997]: INFO oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Caught SIGTERM, stopping children Aug 28 08:40:13 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Acquiring lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:40:13 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Acquired lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:40:13 devstack cinder-volume[84997]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Releasing lock "singleton_lock" {{(pid=84997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:40:13 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Stop services. {{(pid=84997) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 08:40:13 devstack cinder-volume[84997]: DEBUG oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Killing children. {{(pid=84997) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 08:40:13 devstack cinder-volume[84997]: INFO oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Waiting on 1 children to exit Aug 28 08:40:13 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Acquiring lock "singleton_lock" {{(pid=85249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:40:13 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Acquired lock "singleton_lock" {{(pid=85249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:40:13 devstack cinder-volume[85249]: DEBUG oslo_concurrency.lockutils [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Releasing lock "singleton_lock" {{(pid=85249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:40:13 devstack cinder-volume[85249]: WARNING amqp [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 08:40:13 devstack cinder-volume[85249]: WARNING amqp [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 08:40:14 devstack cinder-volume[84997]: INFO oslo_service.backend._eventlet.service [None req-5df6cd4d-7d31-498b-bc5b-e73db51d58a4 None None] Child 85249 exited with status 0 Aug 28 08:40:14 devstack cinder-volume[85523]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 08:40:14 devstack cinder-volume[85523]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 08:40:14 devstack cinder-volume[85523]: we strongly recommend against using it for new projects. Aug 28 08:40:14 devstack cinder-volume[85523]: If you are already using Eventlet, we recommend migrating to a different Aug 28 08:40:14 devstack cinder-volume[85523]: framework. For more detail see Aug 28 08:40:14 devstack cinder-volume[85523]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 08:40:14 devstack cinder-volume[85523]: import eventlet # noqa Aug 28 08:40:17 devstack cinder-volume[85523]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 08:40:17 devstack cinder-volume[85523]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 08:40:17 devstack cinder-volume[85523]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 08:40:18 devstack cinder-volume[85523]: INFO dbcounter [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Registered counter for database cinder Aug 28 08:40:18 devstack cinder-volume[85523]: DEBUG oslo_db.sqlalchemy.engines [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:18 devstack cinder-volume[85523]: DEBUG dbcounter [-] [85523] Writer thread running {{(pid=85523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:40:18 devstack cinder-volume[85523]: INFO cinder.rpc [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 08:40:18 devstack cinder-volume[85523]: INFO cinder.rpc [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 08:40:18 devstack cinder-volume[85523]: DEBUG oslo_db.sqlalchemy.engines [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:18 devstack cinder-volume[85523]: INFO cinder.volume.manager [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Determined volume DB was empty at startup. Aug 28 08:40:18 devstack cinder-volume[85523]: DEBUG cinder.volume.manager [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85523) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 08:40:18 devstack cinder-volume[85523]: WARNING stevedore.named [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 08:40:18 devstack cinder-volume[85523]: WARNING castellan.key_manager [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:40:18 devstack cinder-volume[85523]: WARNING cinder.keymgr.conf_key_mgr [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 08:40:18 devstack cinder-volume[85523]: INFO cinder.volume.manager [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 08:40:18 devstack cinder-volume[85523]: DEBUG oslo_db.sqlalchemy.engines [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:19 devstack cinder-volume[85523]: INFO oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Starting 1 workers Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Started child 85762 {{(pid=85523) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Full set of CONF: {{(pid=85523) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] ******************************************************************************** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] Configuration options gathered from: {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 08:40:19 devstack cinder-volume[85762]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] ================================================================================ {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] allow_availability_zone_fallback = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] allow_compression_on_image_upload = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] allowed_direct_url_schemes = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] api_rate_limit = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] auth_strategy = keystone {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_availability_zone = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_host = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_stats_polling_interval = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backup_api_class = cinder.backup.api.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backup_name_template = backup-%s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backup_use_same_host = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backup_use_temp_snapshot = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] chap_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] chap_username = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_internal_tenant_project_id = e5beaf1a9f3f4e27adb9da9b70fe59a9 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_internal_tenant_user_id = 9ba828fd6dd34f42bbcaae4cc6f37db5 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cluster = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] compression_format = gzip {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] config_dir = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] config_source = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] control_exchange = openstack {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] debug = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] default_availability_zone = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] default_group_type = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] default_volume_type = QuobyteHD {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] disk_geometry = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_client_cert = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85762) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_client_cert_key = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_data_namespace = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_ssl_cert_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_ssl_cert_verify = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] driver_use_ssl = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] enable_new_services = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] enable_unsupported_driver = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] enforce_multipath_for_image_xfer = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] filter_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_api_insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_api_ssl_compression = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_ca_certificates_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_num_retries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance_request_timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] goodness_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] graceful_shutdown_timeout = 5 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] group_api_class = cinder.group.api.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] host = devstack {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_compress_on_upload = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_conversion_address_space_limit = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_conversion_cpu_limit = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_conversion_disable = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_upload_use_cinder_backend = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_upload_use_internal_tenant = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_volume_cache_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_volume_cache_max_count = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] init_host_max_objects_retrieval = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] instance_format = [instance: %(uuid)s] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iscsi_target_flags = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iscsi_write_cache = on {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iser_helper = tgtadm {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iser_ip_address = 192.168.122.188 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iser_port = 3260 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_color = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_config_append = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_dir = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_options = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_rotate_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_rotate_interval_type = days {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] log_rotation_type = none {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] max_age = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] max_logfile_count = 30 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] max_logfile_size_mb = 200 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] max_over_subscription_ratio = 20.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] message_reap_interval = 86400 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] message_ttl = 2592000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] monkey_patch = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] monkey_patch_modules = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] my_ip = 192.168.122.188 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] no_snapshot_gb_quota = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] num_iser_scan_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] num_shell_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] num_volume_device_scan_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] nvmeof_conn_info_version = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85762) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] nvmet_ns_id = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] nvmet_port_id = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_max_limit = 1000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_ext_list = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 08:40:19 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_listen_port = 8776 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_use_ssl = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] osapi_volume_workers = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] per_volume_size_limit = -1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] periodic_fuzzy_delay = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Running cmd (subprocess): mount.quobyte {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] periodic_interval = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] public_endpoint = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] publish_errors = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_backup_gigabytes = 1000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_backups = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_gigabytes = 1000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_groups = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_snapshots = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] quota_volumes = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] rate_limit_burst = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] rate_limit_except_level = CRITICAL {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] rate_limit_interval = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] reinit_driver_count = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] replication_device = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] report_discard_supported = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] report_interval = 120 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] reservation_clean_interval = 86400 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] reservation_expire = 86400 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] reserved_image_namespaces = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] reserved_percentage = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] rpc_response_timeout = 120 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] run_external_periodic_tasks = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] scst_target_driver = iscsi {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] scst_target_iqn_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_down_time = 720 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] shell_completion = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] snapshot_name_template = snapshot-%s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] split_loggers = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] state_path = /opt/stack/data/cinder {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] storage_availability_zone = nova {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] storage_protocol = iSCSI {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] syslog_log_facility = LOG_USER {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_helper = lioadm {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_ip_address = 192.168.122.188 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_port = 3260 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_protocol = iscsi {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] target_secondary_ip_addresses = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] trace_flags = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] transport_url = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] until_refresh = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_chap_auth = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_default_quota_class = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_journal = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_json = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_multipath_for_image_xfer = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_stderr = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] use_syslog = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] verify_glance_signatures = enabled {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_api_class = cinder.volume.api.API {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_backend_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_clear = zero {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_clear_ionice = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_clear_size = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_copy_bps_limit = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_dd_blocksize = 1M {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_name_template = volume-%s {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_service_inithost_offload = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volume_usage_audit_period = month {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] zoning_mode = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.auth_section = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.auth_type = password {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.auth_version = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.cache = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.interface = public {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcache_username = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.region_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.service_type = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.backend = dogpile.cache.null {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.backend_argument = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.backend_expiration_time = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.config_prefix = cache.oslo {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.debug_cache_backend = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.enable_retry_client = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.enable_socket_keepalive = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.expiration_time = 600 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_dead_retry = 300 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_sasl_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.proxies = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.redis_db = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.redis_server = localhost:6379 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.retry_attempts = 2 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.retry_delay = 0.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.socket_keepalive_count = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.socket_keepalive_idle = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.socket_keepalive_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.socket_timeout = 1.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.tls_allowed_ciphers = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.tls_cafile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.tls_certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.tls_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.tls_keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cache.username = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] coordination.backend_url = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.asyncio_connection = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.asyncio_slave_connection = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.backend = sqlalchemy {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.connection = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.connection_debug = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.connection_parameters = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.connection_recycle_time = 3600 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.connection_trace = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.db_inc_retry_interval = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.db_max_retries = 20 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.db_max_retry_interval = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.db_retry_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.max_overflow = 50 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.max_pool_size = 5 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.max_retries = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.pool_timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.retry_interval = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.slave_connection = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.sqlite_synchronous = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.synchronous_reader = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] database.use_db_reconnect = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_tracing.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.connection_string = messaging:// {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.es_doc_type = notification {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.es_scroll_size = 10000 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.es_scroll_time = 2m {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.filter_error_trace = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.hmac_keys = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.sentinel_service_name = mymaster {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.socket_timeout = 0.1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.trace_requests = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler.trace_sqlalchemy = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler_jaeger.process_tags = {} {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] profiler_otlp.service_name_prefix = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.policy_default_rule = default {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.group = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.helper_command = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] privsep_osbrick.user = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.group = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.helper_command = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] cinder_sys_admin.user = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.auth_section = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.auth_type = password {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.cafile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:19 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.collect_timing = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.send_service_user_token = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.split_loggers = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] service_user.timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.auth_section = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.auth_type = password {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.collect_timing = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.region_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.split_loggers = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] glance.timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.backend_availability_zone = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.chap_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.chap_username = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.disk_geometry = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_client_cert = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_data_namespace = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.driver_use_ssl = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.extra_capabilities = {} {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.filter_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.goodness_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iscsi_target_flags = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iser_port = 3260 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_host = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_login = admin {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_mount_options = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_private_key = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_share_path = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.replication_device = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.report_discard_supported = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_helper = tgtadm {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_port = 3260 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_protocol = iscsi {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.trace_flags = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.use_chap_auth = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_backend_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_clear = zero {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_reports.file_event_handler = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_reports.log_dir = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.backend_host = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.chap_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.chap_username = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.disk_geometry = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_client_cert = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.extra_capabilities = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.filter_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.goodness_function = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iser_helper = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iser_ip_address = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iser_port = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_host = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_login = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_mount_options = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_password = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_private_key = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_share_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.num_shell_tries = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.replication_device = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.report_discard_supported = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.reserved_percentage = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.scst_target_driver = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.storage_protocol = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_helper = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_ip_address = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_port = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_prefix = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_protocol = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.trace_flags = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.use_chap_auth = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_clear = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_clear_size = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] QuobyteHD.volumes_dir = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_notifications.driver = [] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] key_manager.fixed_key = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.barbican_api_version = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.barbican_endpoint = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.barbican_endpoint_type = public {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.barbican_region_name = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.cafile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.collect_timing = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.number_of_retries = 60 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.retry_delay = 1 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.send_service_user_token = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.split_loggers = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.verify_ssl = True {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican.verify_ssl_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.auth_section = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.auth_type = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.cafile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.certfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.collect_timing = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.insecure = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.keyfile = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.split_loggers = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] barbican_service_user.timeout = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.approle_role_id = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.approle_secret_id = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.auth_method = approle {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.auth_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.kv_mountpoint = secret {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.kv_path = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.kv_version = 2 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.namespace = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.root_token_id = **** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.ssl_ca_crt_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.timeout = 60.0 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.token_file = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.token_role = None {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.use_ssl = False {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 08:40:19 devstack cinder-volume[85523]: DEBUG oslo_service.backend._eventlet.service [None req-acbc2d6b-ac1e-43a1-a516-ae67202fe6e2 None None] ******************************************************************************** {{(pid=85523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 08:40:20 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.837s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:20 devstack cinder-volume[85762]: INFO cinder.volume.driver [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Driver hasn't implemented _init_vendor_properties() Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.volume.driver [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5886573791504, 'free_capacity_gb': 1774.5886573791504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85762) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_db.sqlalchemy.engines [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writer thread running {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.db.api [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Building query based on filter {{(pid=85762) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85762) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:20 devstack cinder-volume[85762]: INFO cinder.keymgr.migration [None req-5feb47f9-54dc-4aed-a8f8-dbaf8fdcd116 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 08:40:20 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:20 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:20 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.375s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:40:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Driver initialization completed successfully. Aug 28 08:40:20 devstack cinder-volume[85762]: INFO cinder.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Initiating service 3 cleanup Aug 28 08:40:20 devstack cinder-volume[85762]: INFO cinder.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Service 3 cleanup completed. Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.service [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Creating RPC server for service cinder-volume {{(pid=85762) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 08:40:20 devstack cinder-volume[85762]: DEBUG cinder.service [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85762) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 08:40:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:40:21 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:40:21 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:40:21 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Aug 28 08:40:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.306s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:40:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-41fe6ccb-4066-40d8-86cd-ce163ba4991c None None] Driver post RPC initialization completed successfully. Aug 28 08:40:29 devstack cinder-volume[85523]: DEBUG dbcounter [-] [85523] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:40:30 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:40:31 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:40:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:40:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 6 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:40:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Flow 'volume_create_manager' (0c203f5c-fc03-446a-a6e4-94342182c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbeeabd1-a6ee-426a-b93b-4e6b359348f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbeeabd1-a6ee-426a-b93b-4e6b359348f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-576525069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753cc0a4-4291-40a0-bac5-323c537392ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4d5153d5034b41bddaa752f56e4863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:41:28Z,use_quota=True,user_id='a6e4d7d6aaa4461dad724643039715a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ea5f86-b5a5-4d9e-82f9-7b2c1b80662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ea5f86-b5a5-4d9e-82f9-7b2c1b80662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260497e-56c8-434e-803b-d6c36da5c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260497e-56c8-434e-803b-d6c36da5c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753cc0a4-4291-40a0-bac5-323c537392ac', 'volume_name': 'volume-753cc0a4-4291-40a0-bac5-323c537392ac', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6059274-b4c2-4467-8895-7a35b66ef578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6059274-b4c2-4467-8895-7a35b66ef578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de85cb07-1e64-43b0-a1de-1b5b253da993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Volume 753cc0a4-4291-40a0-bac5-323c537392ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753cc0a4-4291-40a0-bac5-323c537392ac', 'volume_size': 1} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-576525069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753cc0a4-4291-40a0-bac5-323c537392ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4d5153d5034b41bddaa752f56e4863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:41:28Z,use_quota=True,user_id='a6e4d7d6aaa4461dad724643039715a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Creating volume 753cc0a4-4291-40a0-bac5-323c537392ac {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:41:28 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:41:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:28 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac 1073741824 Aug 28 08:41:28 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:29 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac 1073741824" returned: 0 in 0.887s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:29 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac Aug 28 08:41:29 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:30 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac" returned: 0 in 0.401s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de85cb07-1e64-43b0-a1de-1b5b253da993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753cc0a4-4291-40a0-bac5-323c537392ac', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f9156-180d-4aad-b232-445d50b8c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:30 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Volume volume-753cc0a4-4291-40a0-bac5-323c537392ac (753cc0a4-4291-40a0-bac5-323c537392ac): created successfully Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f9156-180d-4aad-b232-445d50b8c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Flow 'volume_create_manager' (0c203f5c-fc03-446a-a6e4-94342182c41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:41:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1b7fd89a-8228-4a6e-911a-29c4417732bf tempest-DeleteServersTestJSON-2142222740 None] Created volume successfully. Aug 28 08:41:35 devstack cinder-volume[85762]: WARNING py.warnings [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 28 08:41:35 devstack cinder-volume[85762]: .first() Aug 28 08:41:35 devstack cinder-volume[85762]: Aug 28 08:41:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-753cc0a4-4291-40a0-bac5-323c537392ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ec26bf2-b941-418b-8fc0-3832a2b4326e', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:41:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f15525a4-a904-469b-b5c7-4228f3cf734d req-dbf76342-7477-4725-a9e2-93cc48dbc479 tempest-DeleteServersTestJSON-2142222740 None] attachment_update completed successfully. Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:40 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:41:40 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:40 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.439s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 6 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:41:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:41:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f1ca65be-d6e7-4e40-8eef-6ee7c36a2a4b req-5b0babcb-89df-4731-8d82-9f47bf68448d tempest-DeleteServersTestJSON-2142222740 None] Terminate volume connection completed successfully. Aug 28 08:41:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f1ca65be-d6e7-4e40-8eef-6ee7c36a2a4b req-5b0babcb-89df-4731-8d82-9f47bf68448d tempest-DeleteServersTestJSON-2142222740 None] Deleting attachment 6ec26bf2-b941-418b-8fc0-3832a2b4326e. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:41:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "cinder-753cc0a4-4291-40a0-bac5-323c537392ac-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:41:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "cinder-753cc0a4-4291-40a0-bac5-323c537392ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:41:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "cinder-quobyte-753cc0a4-4291-40a0-bac5-323c537392ac" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:41:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "cinder-quobyte-753cc0a4-4291-40a0-bac5-323c537392ac" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:41:46 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpovd79wd2/privsep.sock'] Aug 28 08:41:46 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpovd79wd2/privsep.sock Aug 28 08:41:46 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 08:41:47 devstack cinder-volume[85762]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 28 08:41:48 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:48 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Spawned new privsep daemon via rootwrap Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Accepted privsep connection to /tmp/tmpovd79wd2/privsep.sock {{(pid=85762) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 28 08:41:48 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 28 08:41:48 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 28 08:41:48 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 28 08:41:48 devstack cinder-volume[85762]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87477 Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4521cf-da79-4354-a4ac-03ae51417f88]: (2,) {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6156e5-9d0a-4bd4-829c-40b7128389b1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:48 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac Aug 28 08:41:48 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:48 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac" returned: 0 in 0.537s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:48 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac Aug 28 08:41:48 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:49 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-753cc0a4-4291-40a0-bac5-323c537392ac" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "cinder-quobyte-753cc0a4-4291-40a0-bac5-323c537392ac" released by "delete_volume" :: held 2.712s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:41:49 devstack cinder-volume[85762]: WARNING cinder.quota [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:41:49 devstack cinder-volume[85762]: WARNING cinder.quota [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Created reservations ['10e37030-e2db-428a-9a1f-304471f42697', '408e7a85-8181-4cc4-a0ba-d7f167ad2ea4', '989bab33-3f56-404e-8024-7912cf40e22a', '79f29a03-9688-4e47-b3d0-4eac82d5a131'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:49 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:41:49 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:49 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.311s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:41:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Deleted volume successfully. Aug 28 08:41:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-610629f4-f910-4521-8d77-854c4a6a7c48 tempest-DeleteServersTestJSON-2142222740 None] Lock "cinder-753cc0a4-4291-40a0-bac5-323c537392ac-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Flow 'volume_create_manager' (1595c1c7-45ad-481e-b1cb-36ec75ec4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6197f1-6d6b-469b-94aa-a302542f97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6197f1-6d6b-469b-94aa-a302542f97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-633570226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9c35cf-46da-4a66-8c94-6e9f50351fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0c2ff0c6cf4dc5a44da2dc0b473c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:41:54Z,use_quota=True,user_id='b4922f0a9c444194a85c8ee72f433340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbc774-c2a1-457f-b25c-ba22efe77434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbc774-c2a1-457f-b25c-ba22efe77434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e836880-b128-4d7c-8b99-11bd74b908b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e836880-b128-4d7c-8b99-11bd74b908b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9c35cf-46da-4a66-8c94-6e9f50351fe6', 'volume_name': 'volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8342136-e84d-4df5-9258-22b7fbd4b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8342136-e84d-4df5-9258-22b7fbd4b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4283aa63-a107-4838-8b0b-7559895be5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:53 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Volume de9c35cf-46da-4a66-8c94-6e9f50351fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6', 'volume_size': 1} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-633570226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9c35cf-46da-4a66-8c94-6e9f50351fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0c2ff0c6cf4dc5a44da2dc0b473c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:41:54Z,use_quota=True,user_id='b4922f0a9c444194a85c8ee72f433340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Creating volume de9c35cf-46da-4a66-8c94-6e9f50351fe6 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:41:53 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:41:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:53 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 1073741824 Aug 28 08:41:53 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:54 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 1073741824" returned: 0 in 0.659s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:54 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 Aug 28 08:41:54 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:55 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6" returned: 0 in 0.618s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4283aa63-a107-4838-8b0b-7559895be5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3049a4-1969-40a4-b1a7-3bd07ae20246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:41:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Volume volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 (de9c35cf-46da-4a66-8c94-6e9f50351fe6): created successfully Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3049a4-1969-40a4-b1a7-3bd07ae20246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:41:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Flow 'volume_create_manager' (1595c1c7-45ad-481e-b1cb-36ec75ec4386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:41:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4080ffcc-178f-48c0-9aa1-dc2af041f9fd tempest-VolumesAdminNegativeTest-2133889783 None] Created volume successfully. Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Acquiring lock "cinder-de9c35cf-46da-4a66-8c94-6e9f50351fe6-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "cinder-de9c35cf-46da-4a66-8c94-6e9f50351fe6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Acquiring lock "cinder-quobyte-de9c35cf-46da-4a66-8c94-6e9f50351fe6" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "cinder-quobyte-de9c35cf-46da-4a66-8c94-6e9f50351fe6" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79011ac-064d-43c7-b2b4-9a961e4a28d5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:41:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:57 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 Aug 28 08:41:57 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:57 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6" returned: 0 in 0.525s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:57 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6 Aug 28 08:41:57 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:57 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-de9c35cf-46da-4a66-8c94-6e9f50351fe6" returned: 0 in 0.402s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "cinder-quobyte-de9c35cf-46da-4a66-8c94-6e9f50351fe6" released by "delete_volume" :: held 0.987s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:41:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Created reservations ['fe61fda8-c96c-46e4-8b8a-61733e38d9fc', 'aed1f0e4-ea51-448d-9bc7-4b3ae923d035', 'b6bccac4-37b4-462f-bb0f-ae0b9c2b9b44', '4172c6a2-d59b-46b0-a6b7-d7ac8c000bf0'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:41:58 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:41:58 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:41:58 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.285s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:41:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Deleted volume successfully. Aug 28 08:41:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a61d985-7ee1-4f2a-9667-57f0ee2f18a8 tempest-VolumesAdminNegativeTest-2133889783 None] Lock "cinder-de9c35cf-46da-4a66-8c94-6e9f50351fe6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Flow 'volume_create_manager' (f07299da-f3c9-411f-91fe-4df1747d882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db610c-fd3a-4768-91af-607d5142e3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db610c-fd3a-4768-91af-607d5142e3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-516894859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8cdccd-bf5d-4bce-a88e-2d354b70d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86664d4357a24ffc94e6a51c91a49ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:02Z,use_quota=True,user_id='ba62d3f9fc5a4196a2175c6c319daeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fee84ff-dee9-4c50-bcb8-19b17352b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fee84ff-dee9-4c50-bcb8-19b17352b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf04ec1d-34c8-43bb-a5d2-b15c50bccb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf04ec1d-34c8-43bb-a5d2-b15c50bccb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8cdccd-bf5d-4bce-a88e-2d354b70d95e', 'volume_name': 'volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77f723-ea08-442c-9425-098a2f44f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77f723-ea08-442c-9425-098a2f44f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b975608a-562e-476c-96a2-ff810ef3d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Volume 2d8cdccd-bf5d-4bce-a88e-2d354b70d95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e', 'volume_size': 1} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-516894859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8cdccd-bf5d-4bce-a88e-2d354b70d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86664d4357a24ffc94e6a51c91a49ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:02Z,use_quota=True,user_id='ba62d3f9fc5a4196a2175c6c319daeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Creating volume 2d8cdccd-bf5d-4bce-a88e-2d354b70d95e {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:42:02 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:42:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:02 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e 1073741824 Aug 28 08:42:02 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:03 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e 1073741824" returned: 0 in 0.560s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:03 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e Aug 28 08:42:03 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:03 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b975608a-562e-476c-96a2-ff810ef3d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0333edff-d949-45e0-a5cb-dbffa31443c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:03 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Volume volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e (2d8cdccd-bf5d-4bce-a88e-2d354b70d95e): created successfully Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0333edff-d949-45e0-a5cb-dbffa31443c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Flow 'volume_create_manager' (f07299da-f3c9-411f-91fe-4df1747d882d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-95c6529c-93e3-4473-8afe-ed31bf49e06f tempest-AttachVolumeShelveTestJSON-812977912 None] Created volume successfully. Aug 28 08:42:13 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:42:13 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=6 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:42:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ccca41cb-a1d1-471a-9dd5-aa71d0a4e25d tempest-GroupsV314Test-1304576827 None] Group tempest-GroupsV314Test-Group-1522041512: creating Aug 28 08:42:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ccca41cb-a1d1-471a-9dd5-aa71d0a4e25d tempest-GroupsV314Test-1304576827 None] Group tempest-GroupsV314Test-Group-1522041512: created successfully Aug 28 08:42:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ccca41cb-a1d1-471a-9dd5-aa71d0a4e25d tempest-GroupsV314Test-1304576827 None] Create group completed successfully. Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Flow 'volume_create_manager' (2d2f6dee-3f28-4175-af80-a30cdeab8409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a8baf7-7880-42bb-8871-a7b56974d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a8baf7-7880-42bb-8871-a7b56974d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1979680412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f32d0528-c168-498e-8a39-4dee69fecbd8,host='devstack@QuobyteHD#QuobyteHD',id=e4b457d5-1882-4e17-9451-a0190ef0dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22dd9750d84a4052826549971d1a1525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:22Z,use_quota=True,user_id='49153eb119334b3ab9c8731ee11f80aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05ecf23-2f42-4e6b-b4cb-aec04128d6dd),volume_type_id=e05ecf23-2f42-4e6b-b4cb-aec04128d6dd)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a94bf76-7085-42ed-b32f-d25b84906e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a94bf76-7085-42ed-b32f-d25b84906e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9768083d-4458-412e-9ca9-4f0070f4302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9768083d-4458-412e-9ca9-4f0070f4302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b457d5-1882-4e17-9451-a0190ef0dd38', 'volume_name': 'volume-e4b457d5-1882-4e17-9451-a0190ef0dd38', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad3cc08-c6da-4e5a-8be4-404da825cab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad3cc08-c6da-4e5a-8be4-404da825cab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ab084b-7d2a-491a-86e7-3cf12212098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Volume e4b457d5-1882-4e17-9451-a0190ef0dd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b457d5-1882-4e17-9451-a0190ef0dd38', 'volume_size': 1} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f32d0528-c168-498e-8a39-4dee69fecbd8,created_at=2026-08-28T06:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1979680412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f32d0528-c168-498e-8a39-4dee69fecbd8,host='devstack@QuobyteHD#QuobyteHD',id=e4b457d5-1882-4e17-9451-a0190ef0dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22dd9750d84a4052826549971d1a1525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:22Z,use_quota=True,user_id='49153eb119334b3ab9c8731ee11f80aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05ecf23-2f42-4e6b-b4cb-aec04128d6dd),volume_type_id=e05ecf23-2f42-4e6b-b4cb-aec04128d6dd)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Creating volume e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:42:21 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:42:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:21 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 1073741824 Aug 28 08:42:21 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:22 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 1073741824" returned: 0 in 0.670s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-69a5be56-dbdf-4c3b-9b30-e673a4cc2905 req-e57261ef-c18a-44fa-878f-696bde1d2c45 tempest-AttachVolumeShelveTestJSON-812977912 None] No connector for attachment 706e6345-2ecd-4775-9dd6-0bdd4a942a8b; skipping storage backend terminate_connection call. {{(pid=85762) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-69a5be56-dbdf-4c3b-9b30-e673a4cc2905 req-e57261ef-c18a-44fa-878f-696bde1d2c45 tempest-AttachVolumeShelveTestJSON-812977912 None] Deleting attachment 706e6345-2ecd-4775-9dd6-0bdd4a942a8b. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:42:22 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:22 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:22 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ab084b-7d2a-491a-86e7-3cf12212098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b457d5-1882-4e17-9451-a0190ef0dd38', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e72373-8508-4f38-a7af-48855d639145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Volume volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 (e4b457d5-1882-4e17-9451-a0190ef0dd38): created successfully Aug 28 08:42:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e72373-8508-4f38-a7af-48855d639145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Flow 'volume_create_manager' (2d2f6dee-3f28-4175-af80-a30cdeab8409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3dcaff71-c56f-43ce-83e1-60f6baac8dab tempest-GroupsV314Test-1304576827 None] Created volume successfully. Aug 28 08:42:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:25 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Cloning volume e4b457d5-1882-4e17-9451-a0190ef0dd38 to volume 9ee75cad-0e71-4539-8e67-870f2c0d82e3 Aug 28 08:42:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Creating offline snapshot 66de0c71-8699-48f5-be9d-a41fdfd3332a of volume e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:42:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[15235412-4dd7-4ff8-b5ff-3758911341c1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:25 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:25 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:26 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.670s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:26 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a 1G Aug 28 08:42:26 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:27 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a 1G" returned: 0 in 0.781s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:27 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:27 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:27 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 0.511s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:27 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:42:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:27 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:27 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:28 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 0.814s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:28 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info Aug 28 08:42:28 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:29 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info" returned: 0 in 0.797s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:29 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:42:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:29 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info Aug 28 08:42:29 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:29 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.info" returned: 0 in 0.554s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Acquiring lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] snapshot: 66de0c71-8699-48f5-be9d-a41fdfd3332a, volume: 9ee75cad-0e71-4539-8e67-870f2c0d82e3, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[51047727-ed57-401a-bc42-c7ed163dbd79]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:30 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:30 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:31 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 1.248s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b457d5-1882-4e17-9451-a0190ef0dd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:42:31 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e5348-d28d-4d87-8cb4-291e701e7113]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:31 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:31 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:32 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.634s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:42:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:42:32 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:42:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:32 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 Aug 28 08:42:32 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:38 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:42:38 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:40 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:42:40 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:41 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:42:43 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3" returned: 0 in 11.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38, size 1024.00 MB, duration 11.26 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:42:43 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Converted 1024.00 MB image at 90.97 MB/s Aug 28 08:42:43 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:43 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 Aug 28 08:42:43 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:43 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" released by "_copy_volume_from_snapshot" :: held 13.897s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Acquiring lock "cinder-quobyte-66de0c71-8699-48f5-be9d-a41fdfd3332a" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-66de0c71-8699-48f5-be9d-a41fdfd3332a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:42:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Deleting offline snapshot 66de0c71-8699-48f5-be9d-a41fdfd3332a of volume e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] snapshot_file for this snap is: volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccabe16-411d-41b6-838f-e88c8d6a4928]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:44 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:44 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:44 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 0.617s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b457d5-1882-4e17-9451-a0190ef0dd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f40c15e-0358-499f-962a-08c33e44369a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:44 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:44 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:45 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.907s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:45 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:45 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:46 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 0.776s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:46 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a Aug 28 08:42:46 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:47 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38.66de0c71-8699-48f5-be9d-a41fdfd3332a" returned: 0 in 0.569s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-66de0c71-8699-48f5-be9d-a41fdfd3332a" released by "_delete_snapshot" :: held 3.073s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:42:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.594s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2b22d1fc-5745-4527-89f0-db0f60ac0e9f tempest-GroupsV314Test-1304576827 None] Create group from source-group-f32d0528-c168-498e-8a39-4dee69fecbd8 completed successfully. Aug 28 08:42:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Acquiring lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:42:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:42:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[72afffdd-0bf1-4d2b-952b-0fdfebf5c94c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Flow 'volume_create_manager' (7460e2e7-eaec-40a1-ad35-e108b426cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf3a06-c75e-47fd-965d-b7dd098f61a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf3a06-c75e-47fd-965d-b7dd098f61a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1564141648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e0271a-417d-496c-8e7f-5a03243b859a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6b51a77ebd441ba9d699bfb05965ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:49Z,use_quota=True,user_id='5b21106a97034392bafab85552195a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beec865-3d09-43db-b497-00fb9e27cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beec865-3d09-43db-b497-00fb9e27cc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d618223b-8633-4041-b12b-40e0fd0a884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d618223b-8633-4041-b12b-40e0fd0a884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e0271a-417d-496c-8e7f-5a03243b859a', 'volume_name': 'volume-46e0271a-417d-496c-8e7f-5a03243b859a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb659381-2bc7-4ce3-9a11-8fafa1e5d23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb659381-2bc7-4ce3-9a11-8fafa1e5d23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:49 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 Aug 28 08:42:49 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c2d06-0178-47a0-90b6-b554e64d17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:49 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Volume 46e0271a-417d-496c-8e7f-5a03243b859a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e0271a-417d-496c-8e7f-5a03243b859a', 'volume_size': 1} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1564141648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e0271a-417d-496c-8e7f-5a03243b859a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6b51a77ebd441ba9d699bfb05965ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:42:49Z,use_quota=True,user_id='5b21106a97034392bafab85552195a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Creating volume 46e0271a-417d-496c-8e7f-5a03243b859a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:42:49 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:42:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:49 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a 1073741824 Aug 28 08:42:49 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:50 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3" returned: 0 in 1.159s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:50 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a 1073741824" returned: 0 in 0.923s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:50 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3 Aug 28 08:42:50 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:50 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a Aug 28 08:42:50 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:50 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a" returned: 0 in 0.581s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c2d06-0178-47a0-90b6-b554e64d17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e0271a-417d-496c-8e7f-5a03243b859a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd37e2-eac1-4bb0-bd72-fb13ae9b9f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:42:50 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee75cad-0e71-4539-8e67-870f2c0d82e3" returned: 0 in 0.772s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:50 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Volume volume-46e0271a-417d-496c-8e7f-5a03243b859a (46e0271a-417d-496c-8e7f-5a03243b859a): created successfully Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd37e2-eac1-4bb0-bd72-fb13ae9b9f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Flow 'volume_create_manager' (7460e2e7-eaec-40a1-ad35-e108b426cf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:42:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-9ee75cad-0e71-4539-8e67-870f2c0d82e3" released by "delete_volume" :: held 2.075s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:42:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-23bb8882-e420-4a37-9303-6211f4392e71 tempest-ServerRescueNegativeTestJSON-632525728 None] Created volume successfully. Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Created reservations ['855be221-5345-4191-b9df-5d0374f77e7c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:42:51 devstack cinder-volume[85762]: WARNING cinder.quota [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1925820565 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1925820565, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:42:51 devstack cinder-volume[85762]: WARNING cinder.quota [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1925820565 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1925820565, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Created reservations ['ca7cb123-595b-4ca4-b59e-e085d826189f', '308223ea-32e1-4c7a-b4fc-333b050b1fd0', '93d3edbf-a0ed-40ce-b27c-7e21ccf06ef9', '3a996435-b69f-47b4-bbc4-3fbeba598920'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:52 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:42:52 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:52 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.594s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:52 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:42:52 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a8e286cc-8d1a-4b83-9659-cd2f9b6d4fc9 tempest-GroupsV314Test-1304576827 None] Delete group completed successfully. Aug 28 08:42:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Acquiring lock "cinder-quobyte-e4b457d5-1882-4e17-9451-a0190ef0dd38" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:42:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-e4b457d5-1882-4e17-9451-a0190ef0dd38" acquired by "delete_volume" :: waited 0.056s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:42:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b29b7e-edd2-48da-b543-b84ad986d89d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:42:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:54 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:54 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:55 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.979s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:55 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38 Aug 28 08:42:55 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:55 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e4b457d5-1882-4e17-9451-a0190ef0dd38" returned: 0 in 0.597s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Lock "cinder-quobyte-e4b457d5-1882-4e17-9451-a0190ef0dd38" released by "delete_volume" :: held 1.810s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Created reservations ['5a9f84bf-6898-48cb-859e-6efaf18f19a4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Created reservations ['ffe26301-ac17-419e-b11e-eb2bd9526254', 'ae6ae4ad-5632-4694-b0fa-d46e2be57a51', '505ad0a8-4199-4454-b25c-41b90ebfd06f', 'c36b63d8-2311-47bc-9b7c-43c289984eb6'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:42:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:42:56 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:42:56 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:42:57 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Aug 28 08:42:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.532s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:42:57 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:42:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f0bf6452-b948-40ec-9050-db7855d78b52 tempest-GroupsV314Test-1304576827 None] Delete group completed successfully. Aug 28 08:43:06 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:DELETE=1,cinder:INSERT=8 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:43:06 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=28,cinder:SELECT=18,cinder:INSERT=3 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Acquiring lock "cinder-46e0271a-417d-496c-8e7f-5a03243b859a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "cinder-46e0271a-417d-496c-8e7f-5a03243b859a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Acquiring lock "cinder-quobyte-46e0271a-417d-496c-8e7f-5a03243b859a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "cinder-quobyte-46e0271a-417d-496c-8e7f-5a03243b859a" acquired by "delete_volume" :: waited 0.052s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872577c-e8e5-4e58-a642-e77bda79290b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:15 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a Aug 28 08:43:15 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:16 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a" returned: 0 in 0.664s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:16 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a Aug 28 08:43:16 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:16 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-46e0271a-417d-496c-8e7f-5a03243b859a" returned: 0 in 0.541s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "cinder-quobyte-46e0271a-417d-496c-8e7f-5a03243b859a" released by "delete_volume" :: held 1.293s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Created reservations ['5b30f35d-f82d-458b-b62d-5f96e63d0278', '40555f82-7d14-46de-bfd0-f6debd7a2c36', '3cc78e9e-1267-4473-8e7e-170f65006aa7', '9876d6d0-d3c6-4312-81a6-825a4caa5712'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:16 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:43:16 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:17 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.552s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:17 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:43:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Deleted volume successfully. Aug 28 08:43:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d3ec39e-d0de-40b9-909d-cb75f88d6c51 tempest-ServerRescueNegativeTestJSON-632525728 None] Lock "cinder-46e0271a-417d-496c-8e7f-5a03243b859a-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Flow 'volume_create_manager' (852b7db0-c9c3-4eeb-ad3e-c91b14aca91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3d29bc-81f7-4903-81b4-2efa0e1ab8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3d29bc-81f7-4903-81b4-2efa0e1ab8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1449024620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f2cfa3-8a1f-40e4-ab01-740f26568c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c713d25d50cc41bdbaf4c53778827537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:26Z,use_quota=True,user_id='f09815e2c06c4e13b9958fbfdfacf6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d42554-e480-448c-a3e6-1b4787168584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d42554-e480-448c-a3e6-1b4787168584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd18affa-adf5-4dd4-b4c5-ad9de863773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd18affa-adf5-4dd4-b4c5-ad9de863773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f2cfa3-8a1f-40e4-ab01-740f26568c15', 'volume_name': 'volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccb001b-8342-4f82-b2db-0a87da31ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccb001b-8342-4f82-b2db-0a87da31ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a872cdf-811a-4099-a0b6-5c1a16e67f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:26 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Volume 89f2cfa3-8a1f-40e4-ab01-740f26568c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15', 'volume_size': 1} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1449024620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f2cfa3-8a1f-40e4-ab01-740f26568c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c713d25d50cc41bdbaf4c53778827537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:26Z,use_quota=True,user_id='f09815e2c06c4e13b9958fbfdfacf6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Creating volume 89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:26 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:26 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 1073741824 Aug 28 08:43:26 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:26 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 1073741824" returned: 0 in 0.617s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:26 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 Aug 28 08:43:26 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:27 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15" returned: 0 in 0.322s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a872cdf-811a-4099-a0b6-5c1a16e67f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c42202-0e4f-49f2-a468-af64edb58edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Volume volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 (89f2cfa3-8a1f-40e4-ab01-740f26568c15): created successfully Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c42202-0e4f-49f2-a468-af64edb58edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Flow 'volume_create_manager' (852b7db0-c9c3-4eeb-ad3e-c91b14aca91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ba557385-0c90-4045-8076-70d4275f354c tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Created volume successfully. Aug 28 08:43:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Creating offline snapshot 7e1f9461-f075-43fb-824c-4431d7699ce8 of volume 89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:43:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[993f8fa4-59b0-4e18-949e-d5a766fbf1ac]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:28 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 Aug 28 08:43:28 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:29 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15" returned: 0 in 0.548s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:29 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 1G Aug 28 08:43:29 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:29 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 1G" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:29 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 Aug 28 08:43:29 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:30 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:30 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 is being set with open permissions: ugo+rw Aug 28 08:43:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:30 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 Aug 28 08:43:30 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:30 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8" returned: 0 in 0.549s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:30 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info Aug 28 08:43:30 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:31 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info" returned: 0 in 0.499s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:31 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info is being set with open permissions: ugo+rw Aug 28 08:43:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:31 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info Aug 28 08:43:31 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:31 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.info" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-51039156-36e2-4a09-9601-d4613cb7fb15 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Create snapshot completed successfully Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Acquiring lock "cinder-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "cinder-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Acquiring lock "cinder-quobyte-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "cinder-quobyte-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9d003-2556-48ae-ae92-af596c566278]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "cinder-7e1f9461-f075-43fb-824c-4431d7699ce8-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-7e1f9461-f075-43fb-824c-4431d7699ce8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "cinder-quobyte-7e1f9461-f075-43fb-824c-4431d7699ce8" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-7e1f9461-f075-43fb-824c-4431d7699ce8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Deleting offline snapshot 7e1f9461-f075-43fb-824c-4431d7699ce8 of volume 89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:43:32 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e Aug 28 08:43:32 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] snapshot_file for this snap is: volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f5380-b43b-4ae0-9514-1a29a837fd7b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:32 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 Aug 28 08:43:32 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:32 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" returned: 0 in 0.539s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:32 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e Aug 28 08:43:32 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:33 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8" returned: 0 in 0.540s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ba793-3a29-4f11-bf51-5c0bb799c7c4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:33 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" returned: 0 in 0.338s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "cinder-quobyte-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e" released by "delete_volume" :: held 0.957s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:33 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 Aug 28 08:43:33 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Created reservations ['d77fdebb-09c9-4341-8b72-2f112d91d1f4', 'a1c2d203-cfe6-483e-be85-345d13ce379e', 'cb52f0b3-f939-46bf-a81d-de888b31f003', '4edd60f9-846f-4c1f-a80f-1e9ced1f770a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:33 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:43:33 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:33 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15" returned: 0 in 0.629s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:33 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 Aug 28 08:43:33 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:34 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.335s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:43:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Deleted volume successfully. Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a7c88e7f-4899-473d-a8b1-d2125b770abe tempest-AttachVolumeShelveTestJSON-812977912 None] Lock "cinder-2d8cdccd-bf5d-4bce-a88e-2d354b70d95e-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:34 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8" returned: 0 in 0.513s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:34 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8 Aug 28 08:43:34 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:34 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15.7e1f9461-f075-43fb-824c-4431d7699ce8" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-7e1f9461-f075-43fb-824c-4431d7699ce8" released by "_delete_snapshot" :: held 2.264s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" released by "delete_snapshot" :: held 2.304s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:34 devstack cinder-volume[85762]: WARNING cinder.quota [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:43:34 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Created reservations ['8e07a1b6-7c20-462c-9caf-b48385f8fab4', '02b1a570-d393-4982-a015-b8a65dd7dc40', 'e9cb6903-2d10-44bb-b4f1-572e0672cb89', 'b2c76025-55f2-4176-9ee8-b962e88204b3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:43:35 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Delete snapshot completed successfully. Aug 28 08:43:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2adba629-c7de-410b-8766-3b387ca02e58 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-7e1f9461-f075-43fb-824c-4431d7699ce8-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "cinder-89f2cfa3-8a1f-40e4-ab01-740f26568c15-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-89f2cfa3-8a1f-40e4-ab01-740f26568c15-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133357e-e97d-4fee-b812-8bf964ef2996]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Flow 'volume_create_manager' (52118aeb-5eb6-4783-a50f-44385c8f7659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e751390-7eea-4607-a42d-ba49a4917180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e751390-7eea-4607-a42d-ba49a4917180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-460008440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3b6644-11df-4cc3-b66c-7a433d41304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876c27e14a7f4e72a71c8dcc36bc61da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:36Z,use_quota=True,user_id='ef1ead188e7946e292af3091680ce209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d421f526-d864-442a-8bc6-09d39d04712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d421f526-d864-442a-8bc6-09d39d04712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68f0f7-e5e4-4deb-afcf-b8826823ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68f0f7-e5e4-4deb-afcf-b8826823ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3b6644-11df-4cc3-b66c-7a433d41304b', 'volume_name': 'volume-6b3b6644-11df-4cc3-b66c-7a433d41304b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6535b770-2a6c-4723-b823-dca12d2872b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6535b770-2a6c-4723-b823-dca12d2872b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa57ecb3-9e5e-40d6-9341-bffc6684b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Volume 6b3b6644-11df-4cc3-b66c-7a433d41304b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3b6644-11df-4cc3-b66c-7a433d41304b', 'volume_size': 1} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-460008440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3b6644-11df-4cc3-b66c-7a433d41304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='876c27e14a7f4e72a71c8dcc36bc61da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:36Z,use_quota=True,user_id='ef1ead188e7946e292af3091680ce209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Creating volume 6b3b6644-11df-4cc3-b66c-7a433d41304b {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:36 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:36 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 Aug 28 08:43:36 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:36 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b 1073741824 Aug 28 08:43:36 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:36 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15" returned: 0 in 0.551s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:36 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15 Aug 28 08:43:36 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:36 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b 1073741824" returned: 0 in 0.549s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:36 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b Aug 28 08:43:36 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:37 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-89f2cfa3-8a1f-40e4-ab01-740f26568c15" returned: 0 in 0.359s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-quobyte-89f2cfa3-8a1f-40e4-ab01-740f26568c15" released by "delete_volume" :: held 1.009s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Created reservations ['e42ee75a-3f54-4583-8fc2-def69b4ecb67', '7976e781-8aa2-4dac-9049-8320b2aa1795', 'b7dea343-04a5-4dab-aa48-dab12164014d', 'abd907f4-b62e-4bff-96bd-ed7f7c91ea2d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:43:37 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b" returned: 0 in 0.329s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa57ecb3-9e5e-40d6-9341-bffc6684b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3b6644-11df-4cc3-b66c-7a433d41304b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6a5d3b-37f1-46c2-b6b0-88c7917a6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:37 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Volume volume-6b3b6644-11df-4cc3-b66c-7a433d41304b (6b3b6644-11df-4cc3-b66c-7a433d41304b): created successfully Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6a5d3b-37f1-46c2-b6b0-88c7917a6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Flow 'volume_create_manager' (52118aeb-5eb6-4783-a50f-44385c8f7659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1b594887-5a4e-472b-92b7-fb72baaa6972 tempest-TaggedAttachmentsTest-1534693561 None] Created volume successfully. Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:37 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:43:37 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:37 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.361s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:43:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Deleted volume successfully. Aug 28 08:43:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7c92547e-cb72-48ff-976b-ed8825cbfae9 tempest-VolumeSnapshotQuotasNegativeTestJSON-155339079 None] Lock "cinder-89f2cfa3-8a1f-40e4-ab01-740f26568c15-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:40 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:43:40 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:40 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.317s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 8 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:43:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (3528ff05-53a5-4888-a1ae-08459350c6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6fa62-793d-4f8b-995d-81a7212f1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6fa62-793d-4f8b-995d-81a7212f1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-982467643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082203fe-f9fb-4901-9e39-f12fb81697bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:45Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd136b4-caaf-4e34-8c7b-fe717766fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd136b4-caaf-4e34-8c7b-fe717766fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d3a38e-4a79-485e-aee8-e368dd9423a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d3a38e-4a79-485e-aee8-e368dd9423a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082203fe-f9fb-4901-9e39-f12fb81697bb', 'volume_name': 'volume-082203fe-f9fb-4901-9e39-f12fb81697bb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba0c823-0563-4370-b3c8-4056d5289847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba0c823-0563-4370-b3c8-4056d5289847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d9898-1ff0-4cdc-a374-6b04f583f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Volume 082203fe-f9fb-4901-9e39-f12fb81697bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082203fe-f9fb-4901-9e39-f12fb81697bb', 'volume_size': 1} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-982467643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082203fe-f9fb-4901-9e39-f12fb81697bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:45Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Creating volume 082203fe-f9fb-4901-9e39-f12fb81697bb {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:45 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb 1073741824 Aug 28 08:43:45 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:46 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb 1073741824" returned: 0 in 0.725s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:46 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb Aug 28 08:43:46 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:46 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d9898-1ff0-4cdc-a374-6b04f583f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082203fe-f9fb-4901-9e39-f12fb81697bb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf190c29-f586-453e-89bd-94f722d66405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Volume volume-082203fe-f9fb-4901-9e39-f12fb81697bb (082203fe-f9fb-4901-9e39-f12fb81697bb): created successfully Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf190c29-f586-453e-89bd-94f722d66405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (3528ff05-53a5-4888-a1ae-08459350c6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-490c764f-a7e0-4a79-a1be-3eeb35ba1b4e tempest-VolumesTestJSON-1290947583 None] Created volume successfully. Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (53abb09d-2cde-4bbc-82bd-c6f15de5bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce79388-2d5d-42c7-bc56-ee68352bd228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce79388-2d5d-42c7-bc56-ee68352bd228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853111881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade6103c-78a1-4f3e-b28b-a3fffa77f154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:48Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355a16cf-0ac9-485b-bd72-65d53f8d06eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355a16cf-0ac9-485b-bd72-65d53f8d06eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4573ca-dcec-42af-8ebe-8df049745473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4573ca-dcec-42af-8ebe-8df049745473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade6103c-78a1-4f3e-b28b-a3fffa77f154', 'volume_name': 'volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e9f9f-f055-4086-a520-07c010cdaca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e9f9f-f055-4086-a520-07c010cdaca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ce9410-7493-4441-b4b3-1edfb0a95846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:48 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Volume ade6103c-78a1-4f3e-b28b-a3fffa77f154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154', 'volume_size': 1} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853111881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade6103c-78a1-4f3e-b28b-a3fffa77f154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:48Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Creating volume ade6103c-78a1-4f3e-b28b-a3fffa77f154 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:48 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:48 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 1073741824 Aug 28 08:43:48 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:49 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 1073741824" returned: 0 in 0.526s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:49 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 Aug 28 08:43:49 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:49 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154" returned: 0 in 0.312s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ce9410-7493-4441-b4b3-1edfb0a95846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d4d247-623b-4a64-9412-742051f6c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:49 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Volume volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 (ade6103c-78a1-4f3e-b28b-a3fffa77f154): created successfully Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d4d247-623b-4a64-9412-742051f6c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (53abb09d-2cde-4bbc-82bd-c6f15de5bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a5c87924-c907-4878-a5fe-1cb66c13c71d tempest-VolumesTestJSON-1290947583 None] Created volume successfully. Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (81ce108e-6cbf-4482-9b1c-4b3e616d6600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b096125a-9dd8-4434-8268-24df3c3fe221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b096125a-9dd8-4434-8268-24df3c3fe221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1556516666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccedd9a-3bbc-4eda-af25-c758a07af35f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:51Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04cafb-0703-49ac-9f0d-da95d8ef8db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04cafb-0703-49ac-9f0d-da95d8ef8db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0187e598-a33e-4c78-b1fd-c93a707ffcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0187e598-a33e-4c78-b1fd-c93a707ffcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ccedd9a-3bbc-4eda-af25-c758a07af35f', 'volume_name': 'volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca672db-8eb3-45db-a939-0f1012fbd736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca672db-8eb3-45db-a939-0f1012fbd736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a774dd7-87d6-4b69-9170-ef24f368ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:51 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Volume 4ccedd9a-3bbc-4eda-af25-c758a07af35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f', 'volume_size': 1} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1556516666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccedd9a-3bbc-4eda-af25-c758a07af35f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c03e6167226940e1ba1f6bd34fbf4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:51Z,use_quota=True,user_id='6925ac4b12854163a56f1160520df126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Creating volume 4ccedd9a-3bbc-4eda-af25-c758a07af35f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:51 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:51 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f 1073741824 Aug 28 08:43:51 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:52 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f 1073741824" returned: 0 in 0.667s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:52 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f Aug 28 08:43:52 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:52 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a774dd7-87d6-4b69-9170-ef24f368ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec753f0-c932-441c-b833-5cb33e29029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:52 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Volume volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f (4ccedd9a-3bbc-4eda-af25-c758a07af35f): created successfully Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec753f0-c932-441c-b833-5cb33e29029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Flow 'volume_create_manager' (81ce108e-6cbf-4482-9b1c-4b3e616d6600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:52 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ea5474f6-bed6-4b09-b4d7-3fd8b38e551b tempest-VolumesTestJSON-1290947583 None] Created volume successfully. Aug 28 08:43:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-4ccedd9a-3bbc-4eda-af25-c758a07af35f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "cinder-4ccedd9a-3bbc-4eda-af25-c758a07af35f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-quobyte-4ccedd9a-3bbc-4eda-af25-c758a07af35f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-4ccedd9a-3bbc-4eda-af25-c758a07af35f" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f2dc2-c5c4-46ba-8127-a18043a8de62]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:56 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f Aug 28 08:43:56 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:56 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f" returned: 0 in 0.759s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:56 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f Aug 28 08:43:56 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (b93232dd-b34b-4cb4-8d06-bae7c0b11365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c2563b-58d1-4b34-974d-c51352423aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:57 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4ccedd9a-3bbc-4eda-af25-c758a07af35f" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c2563b-58d1-4b34-974d-c51352423aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2042776707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7634f51-a659-4411-ace1-71ef5a1d1f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2484b970b26f4c1f938eead41e529f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:57Z,use_quota=True,user_id='bd890a3d5f3a4670a43de776fc3a2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7623f179-8a8a-4270-828d-fe7755b6a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7623f179-8a8a-4270-828d-fe7755b6a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d44959-d8dc-4d59-a7ba-f07816c93346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d44959-d8dc-4d59-a7ba-f07816c93346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7634f51-a659-4411-ace1-71ef5a1d1f74', 'volume_name': 'volume-b7634f51-a659-4411-ace1-71ef5a1d1f74', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cdc0c1-ebd4-4779-aece-2bdbffa5bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cdc0c1-ebd4-4779-aece-2bdbffa5bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d76d73-b866-4da9-9252-3bb638a8fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:57 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Volume b7634f51-a659-4411-ace1-71ef5a1d1f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7634f51-a659-4411-ace1-71ef5a1d1f74', 'volume_size': 1} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2042776707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7634f51-a659-4411-ace1-71ef5a1d1f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2484b970b26f4c1f938eead41e529f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:43:57Z,use_quota=True,user_id='bd890a3d5f3a4670a43de776fc3a2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Creating volume b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:43:57 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-4ccedd9a-3bbc-4eda-af25-c758a07af35f" released by "delete_volume" :: held 1.379s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:57 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 1073741824 Aug 28 08:43:57 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Created reservations ['67178694-2e47-40c3-b476-568d6c1471f0', '8a552d2e-6b5e-43c7-9983-94d6e4208e55', 'fcd8e7cd-0481-4c8a-b047-b2c207a8e3ed', '2629c79d-a4c9-438d-84a6-605c875c0d05'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:57 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:43:57 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:58 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-ade6103c-78a1-4f3e-b28b-a3fffa77f154-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.690s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:43:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Deleted volume successfully. Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-ade6103c-78a1-4f3e-b28b-a3fffa77f154-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:58 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 1073741824" returned: 0 in 1.130s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3900eda8-825a-4130-b4b2-ad420ae5492f tempest-VolumesTestJSON-1290947583 None] Lock "cinder-4ccedd9a-3bbc-4eda-af25-c758a07af35f-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-quobyte-ade6103c-78a1-4f3e-b28b-a3fffa77f154" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-ade6103c-78a1-4f3e-b28b-a3fffa77f154" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3075a-b3ae-437f-a137-1da66a887887]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:43:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:58 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:43:58 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:59 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 Aug 28 08:43:59 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:59 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.618s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d76d73-b866-4da9-9252-3bb638a8fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7634f51-a659-4411-ace1-71ef5a1d1f74', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf887e8c-6902-4b7b-8d58-36bb889b2d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:43:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Volume volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 (b7634f51-a659-4411-ace1-71ef5a1d1f74): created successfully Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf887e8c-6902-4b7b-8d58-36bb889b2d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (b93232dd-b34b-4cb4-8d06-bae7c0b11365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:43:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9a134cb6-b127-417c-bb4c-77bd7f45daa8 tempest-VolumesDeleteCascade-947953010 None] Created volume successfully. Aug 28 08:43:59 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154" returned: 0 in 0.820s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:43:59 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154 Aug 28 08:43:59 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:43:59 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Aug 28 08:43:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ade6103c-78a1-4f3e-b28b-a3fffa77f154" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-ade6103c-78a1-4f3e-b28b-a3fffa77f154" released by "delete_volume" :: held 1.213s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Created reservations ['376ba77d-11ca-4d4e-b575-5d31f4d326d3', '021f4c5b-4bbe-47fc-b0b8-248cdb53420f', '54c9f3a8-c26f-44c6-9083-f58a44dcb756', '57c71912-50f1-48a0-98f1-fb86814a03b3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:00 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:00 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:00 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.586s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Deleted volume successfully. Aug 28 08:44:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29867928-e677-4ad7-a5f7-c1215fd76af3 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-ade6103c-78a1-4f3e-b28b-a3fffa77f154-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-082203fe-f9fb-4901-9e39-f12fb81697bb-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-082203fe-f9fb-4901-9e39-f12fb81697bb-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Creating offline snapshot 1ce378b3-b146-4436-940e-58e9a0b90137 of volume b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "cinder-quobyte-082203fe-f9fb-4901-9e39-f12fb81697bb" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd146fea-9748-406b-8b95-e91e0db04666]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-082203fe-f9fb-4901-9e39-f12fb81697bb" acquired by "delete_volume" :: waited 0.046s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6c272-dc98-47f7-8e77-bce33d54d7b7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:01 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:01 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:01 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb Aug 28 08:44:01 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:01 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.666s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:01 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 1G Aug 28 08:44:01 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:02 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb" returned: 0 in 0.667s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:02 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb Aug 28 08:44:02 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:02 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-082203fe-f9fb-4901-9e39-f12fb81697bb" returned: 0 in 0.581s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-quobyte-082203fe-f9fb-4901-9e39-f12fb81697bb" released by "delete_volume" :: held 1.319s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Created reservations ['9acca8aa-0e62-4836-801f-6fb6a16b532d', 'df4681e8-1275-4c53-b925-c1e683509692', 'abd5e8f1-592a-4581-9216-132f9de21e50', '49144ce8-7ff2-4de6-8654-b22a44855920'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:02 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 1G" returned: 0 in 0.837s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:02 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:02 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:02 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:02 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:03 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Deleted volume successfully. Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aca48414-7a0d-4eac-86ee-609e2aa5d061 tempest-VolumesTestJSON-1290947583 None] Lock "cinder-082203fe-f9fb-4901-9e39-f12fb81697bb-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:03 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.649s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:03 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 is being set with open permissions: ugo+rw Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:03 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:03 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:03 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.529s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:04 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info Aug 28 08:44:04 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:04 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info" returned: 0 in 0.506s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:04 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info is being set with open permissions: ugo+rw Aug 28 08:44:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:04 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info Aug 28 08:44:04 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:05 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.info" returned: 0 in 0.575s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.946s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bb5dfcd0-d264-4c1e-8100-1a487b62dede tempest-VolumesDeleteCascade-947953010 None] Create snapshot completed successfully Aug 28 08:44:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Creating offline snapshot f08855f9-a91f-4d98-95c2-c151da57c0fa of volume b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:44:06 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d7b330-f0fb-4817-95e3-6fe94f7f9b47]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:06 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:06 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:06 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.676s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7634f51-a659-4411-ace1-71ef5a1d1f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:06 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa 1G Aug 28 08:44:06 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:07 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa 1G" returned: 0 in 0.824s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:07 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:07 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:07 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.448s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:07 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa is being set with open permissions: ugo+rw Aug 28 08:44:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:08 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:08 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:08 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.347s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:08 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=67,cinder:SELECT=58,cinder:INSERT=24,cinder:DELETE=5 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:44:08 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=83,cinder:DELETE=9 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:44:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3b2269bd-acd1-48ff-ab37-390087f72414 tempest-VolumesDeleteCascade-947953010 None] Create snapshot completed successfully Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-b7634f51-a659-4411-ace1-71ef5a1d1f74-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-b7634f51-a659-4411-ace1-71ef5a1d1f74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Performing cascade delete. {{(pid=85762) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-1ce378b3-b146-4436-940e-58e9a0b90137-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-1ce378b3-b146-4436-940e-58e9a0b90137-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-1ce378b3-b146-4436-940e-58e9a0b90137" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-1ce378b3-b146-4436-940e-58e9a0b90137" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Deleting offline snapshot 1ce378b3-b146-4436-940e-58e9a0b90137 of volume b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] snapshot_file for this snap is: volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[40895de1-7f38-4c4c-aa3e-483d86307313]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:09 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:09 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:10 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.548s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7634f51-a659-4411-ace1-71ef5a1d1f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f0f13-d3ab-45b5-919d-f695a5f11f1b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:10 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:10 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-30af0eaf-4668-43e7-b148-e5e50c9bf714 tempest-BackendsCapabilitiesAdminTestsJSON-603771581 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5886573791504, 'free_capacity_gb': 1774.5886573791504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85762) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-37994957-078f-4844-aa95-aac5cb440d16 tempest-BackendsCapabilitiesAdminTestsJSON-603771581 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5886573791504, 'free_capacity_gb': 1774.5886573791504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85762) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 08:44:10 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.532s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c267f-64a3-4bbb-beb9-228737287020]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:10 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:10 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:11 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.484s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7634f51-a659-4411-ace1-71ef5a1d1f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e914ba-283a-441a-a9dd-903f74cb0505]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:11 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:11 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:11 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.472s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7634f51-a659-4411-ace1-71ef5a1d1f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[67afcc26-4d69-4d80-871b-6e1728ab529c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:11 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:11 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:12 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.588s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:12 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:12 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:12 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.558s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:12 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137 Aug 28 08:44:12 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:13 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.1ce378b3-b146-4436-940e-58e9a0b90137" returned: 0 in 0.382s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa -F qcow2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:13 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa -F qcow2 Aug 28 08:44:13 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:13 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa -F qcow2" returned: 0 in 0.539s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-1ce378b3-b146-4436-940e-58e9a0b90137" released by "_delete_snapshot" :: held 4.377s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" released by "delete_snapshot" :: held 4.411s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['77947f48-73a0-4ba7-936c-850014d8c7ef', 'dde8923b-57e7-4adb-8ac8-69172e45acc4', '36d5eebe-20dd-4ad6-a841-3b0e3f4314a3', 'bf0a4ba9-40c4-4910-b5ed-582d1cbe018b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Delete snapshot completed successfully. Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-1ce378b3-b146-4436-940e-58e9a0b90137-delete_snapshot" released by "delete_snapshot" :: held 4.655s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-f08855f9-a91f-4d98-95c2-c151da57c0fa-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-f08855f9-a91f-4d98-95c2-c151da57c0fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-f08855f9-a91f-4d98-95c2-c151da57c0fa" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-f08855f9-a91f-4d98-95c2-c151da57c0fa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Deleting offline snapshot f08855f9-a91f-4d98-95c2-c151da57c0fa of volume b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] snapshot_file for this snap is: volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed9a72-473a-4e87-a74d-91da68d50879]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:14 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:14 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:14 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.523s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7634f51-a659-4411-ace1-71ef5a1d1f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47de3fd-f9ed-47bc-ad62-79e4c923c86d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:14 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:14 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:15 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.474s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:15 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:15 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:15 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.445s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:15 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa Aug 28 08:44:15 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:16 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74.f08855f9-a91f-4d98-95c2-c151da57c0fa" returned: 0 in 0.407s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-f08855f9-a91f-4d98-95c2-c151da57c0fa" released by "_delete_snapshot" :: held 2.001s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" released by "delete_snapshot" :: held 2.038s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['9ab446a7-1ff4-4cf7-ab1f-7e40e000274a', 'da2227eb-3d2f-4920-ba64-b268106813fa', '18709fff-4c51-4d43-8f5a-c57d52d6aea9', '650f5a39-2b8a-4607-9d6a-df69af2b4bed'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Delete snapshot completed successfully. Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-f08855f9-a91f-4d98-95c2-c151da57c0fa-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Snapshots deleted, issuing volume delete {{(pid=85762) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91574ad-337f-42bd-b94a-4dae01120c56]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:16 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:16 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:17 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.760s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:17 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74 Aug 28 08:44:17 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:17 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b7634f51-a659-4411-ace1-71ef5a1d1f74" returned: 0 in 0.569s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b7634f51-a659-4411-ace1-71ef5a1d1f74" released by "delete_volume" :: held 1.455s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['2ab9dcb3-4d53-4abc-8d9e-bb58b6d05cdb', '1ec2cf4e-e74f-4fc6-8e72-7004d638ecc2', '7d72df5a-a6a3-4e2f-b1be-cbe87893f0d9', 'adf71d31-2fb6-436a-8a7a-e1ce655d608b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:18 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:18 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:18 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.703s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:18 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Deleted volume successfully. Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b4ba5149-35b6-477f-89cc-f4134f3fe1d1 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-b7634f51-a659-4411-ace1-71ef5a1d1f74-delete_volume" released by "delete_volume" :: held 9.744s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9253497a-12fe-480f-857c-0b677e7c6516 tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-1583602373: creating Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (ade69f2b-b63f-4b58-830d-f1c8f0e59713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a24628-bae1-4e70-96bb-7ee3108a7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a24628-bae1-4e70-96bb-7ee3108a7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1157153997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b871ef39-6b35-47b5-8dd2-4d32bd4130f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2484b970b26f4c1f938eead41e529f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:20Z,use_quota=True,user_id='bd890a3d5f3a4670a43de776fc3a2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f8209-fbd2-4989-bee4-f6354008f67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f8209-fbd2-4989-bee4-f6354008f67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f4e1f2-35bd-48db-8645-e1e38aa6c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f4e1f2-35bd-48db-8645-e1e38aa6c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b871ef39-6b35-47b5-8dd2-4d32bd4130f8', 'volume_name': 'volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20e5223-fc1a-4e90-ad5e-204722962869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20e5223-fc1a-4e90-ad5e-204722962869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d404379-4783-4cda-b612-d08c42df8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Volume b871ef39-6b35-47b5-8dd2-4d32bd4130f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8', 'volume_size': 1} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1157153997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b871ef39-6b35-47b5-8dd2-4d32bd4130f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2484b970b26f4c1f938eead41e529f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:20Z,use_quota=True,user_id='bd890a3d5f3a4670a43de776fc3a2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Creating volume b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:19 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:44:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9253497a-12fe-480f-857c-0b677e7c6516 tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-1583602373: created successfully Aug 28 08:44:20 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 1073741824 Aug 28 08:44:20 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9253497a-12fe-480f-857c-0b677e7c6516 tempest-GroupSnapshotsTest-653247948 None] Create group completed successfully. Aug 28 08:44:20 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 1073741824" returned: 0 in 0.581s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:20 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:20 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:21 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 0.627s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d404379-4783-4cda-b612-d08c42df8619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e1bdd0-96d5-42ea-accb-d70c999edcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Volume volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 (b871ef39-6b35-47b5-8dd2-4d32bd4130f8): created successfully Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e1bdd0-96d5-42ea-accb-d70c999edcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (ade69f2b-b63f-4b58-830d-f1c8f0e59713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-dd41e658-f021-4e6e-86c7-2e15874507f7 tempest-VolumesDeleteCascade-947953010 None] Created volume successfully. Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (08fcc2e1-d540-4068-ae40-02dc62b85d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78635f9-357d-4619-8843-2e1e6bb333fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78635f9-357d-4619-8843-2e1e6bb333fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635404405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d73e0d04-4b7b-45d6-9297-ee11be79b21f,host='devstack@QuobyteHD#QuobyteHD',id=2e78987c-bdcb-4998-baf6-7994699323b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:22Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a19eafc4-b85e-48c0-baf2-a1041a6f2a24),volume_type_id=a19eafc4-b85e-48c0-baf2-a1041a6f2a24)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5018f-190d-4759-8610-471a9a8a14c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5018f-190d-4759-8610-471a9a8a14c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150f793f-e48a-4336-8cb7-e3be96e69a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150f793f-e48a-4336-8cb7-e3be96e69a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e78987c-bdcb-4998-baf6-7994699323b9', 'volume_name': 'volume-2e78987c-bdcb-4998-baf6-7994699323b9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab503f0-beb9-4382-9989-e54ac4a50b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab503f0-beb9-4382-9989-e54ac4a50b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f8535b-3793-4756-a112-25bd1e182be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Volume 2e78987c-bdcb-4998-baf6-7994699323b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e78987c-bdcb-4998-baf6-7994699323b9', 'volume_size': 1} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d73e0d04-4b7b-45d6-9297-ee11be79b21f,created_at=2026-08-28T06:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-635404405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d73e0d04-4b7b-45d6-9297-ee11be79b21f,host='devstack@QuobyteHD#QuobyteHD',id=2e78987c-bdcb-4998-baf6-7994699323b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:22Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a19eafc4-b85e-48c0-baf2-a1041a6f2a24),volume_type_id=a19eafc4-b85e-48c0-baf2-a1041a6f2a24)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Creating volume 2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:21 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:44:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:21 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 1073741824 Aug 28 08:44:21 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:22 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 1073741824" returned: 0 in 0.647s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:22 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:22 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:23 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.441s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.678s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Creating offline snapshot 7ec564aa-2908-4b01-ac12-d5053e9e34c7 of volume b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f8535b-3793-4756-a112-25bd1e182be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e78987c-bdcb-4998-baf6-7994699323b9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4806ecf-37b1-438f-b3b9-ee23744b1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2aef5-0f06-4039-a931-f72ce0a8f1cf]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Volume volume-2e78987c-bdcb-4998-baf6-7994699323b9 (2e78987c-bdcb-4998-baf6-7994699323b9): created successfully Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4806ecf-37b1-438f-b3b9-ee23744b1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (08fcc2e1-d540-4068-ae40-02dc62b85d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0f245a75-2af0-4834-b97a-7cf7acc65175 tempest-GroupSnapshotsTest-653247948 None] Created volume successfully. Aug 28 08:44:23 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:23 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:23 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 0.487s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:23 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 1G Aug 28 08:44:23 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:24 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 1G" returned: 0 in 0.578s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:24 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:24 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] GroupSnapshot a986c152-cefe-4e2d-b2e4-d22eec825929: creating. Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Group snapshot a986c152-cefe-4e2d-b2e4-d22eec825929: creating. {{(pid=85762) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:24 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 0.644s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 is being set with open permissions: ugo+rw Aug 28 08:44:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:24 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:24 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:25 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 0.293s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:25 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info Aug 28 08:44:25 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:25 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:25 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info is being set with open permissions: ugo+rw Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:25 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info Aug 28 08:44:25 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:25 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.info" returned: 0 in 0.379s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.078s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Creating offline snapshot 41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa of volume 2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:44:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-176f5a5a-918c-4d0a-b0eb-b6c35a843d38 tempest-VolumesDeleteCascade-947953010 None] Create snapshot completed successfully Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecced35-1144-4715-ba2f-09d8350dd8aa]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:26 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:26 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:26 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.507s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:26 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa 1G Aug 28 08:44:26 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:27 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa 1G" returned: 0 in 0.685s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e78987c-bdcb-4998-baf6-7994699323b9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:27 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e78987c-bdcb-4998-baf6-7994699323b9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:27 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (8a3f3d9d-63c4-4614-8ed4-e43a2610e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62773b80-32c5-4dd5-bec3-86d96b9d1cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62773b80-32c5-4dd5-bec3-86d96b9d1cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-447694541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254558c0-f000-4aaf-83bb-80e02f9f236e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2484b970b26f4c1f938eead41e529f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ec564aa-2908-4b01-ac12-d5053e9e34c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:27Z,use_quota=True,user_id='bd890a3d5f3a4670a43de776fc3a2436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46dbc13-43f6-4711-8f47-5051ff363618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46dbc13-43f6-4711-8f47-5051ff363618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc85ca1-254f-4685-93de-5db46ebdf7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc85ca1-254f-4685-93de-5db46ebdf7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '254558c0-f000-4aaf-83bb-80e02f9f236e', 'volume_name': 'volume-254558c0-f000-4aaf-83bb-80e02f9f236e', 'volume_size': 1, 'snapshot_id': '7ec564aa-2908-4b01-ac12-d5053e9e34c7'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e845a58-9d47-466e-ac84-1a30ee1b5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e845a58-9d47-466e-ac84-1a30ee1b5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b2df4c-4896-4248-9f0e-2c1441ebe1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Volume 254558c0-f000-4aaf-83bb-80e02f9f236e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-254558c0-f000-4aaf-83bb-80e02f9f236e', 'volume_size': 1, 'snapshot_id': '7ec564aa-2908-4b01-ac12-d5053e9e34c7'} Aug 28 08:44:27 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e78987c-bdcb-4998-baf6-7994699323b9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.678s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:27 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:27 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:27 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:28 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.370s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:28 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info Aug 28 08:44:28 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:28 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:28 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:28 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info Aug 28 08:44:28 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:28 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.info" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7-254558c0-f000-4aaf-83bb-80e02f9f236e" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7-254558c0-f000-4aaf-83bb-80e02f9f236e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Creating volume 254558c0-f000-4aaf-83bb-80e02f9f236e from snapshot 7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] snapshot: 7ec564aa-2908-4b01-ac12-d5053e9e34c7, volume: 254558c0-f000-4aaf-83bb-80e02f9f236e, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[434718f1-6832-4fab-896f-bb16261c3c04]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-dddcf60e-0bb3-4947-a3ef-647c7c42eca7 tempest-GroupSnapshotsTest-653247948 None] group_snapshot a986c152-cefe-4e2d-b2e4-d22eec825929: created successfully Aug 28 08:44:29 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:29 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:30 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 1.107s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[84532669-cc89-4406-8c81-1fc41d30a9c0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:30 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:30 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:31 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 0.978s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:44:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:44:31 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:44:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:31 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e Aug 28 08:44:31 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-37db4e98-14c5-4e93-939f-08a02655a5a2 req-fb7a67b7-717b-41b5-b204-d031dcc431e1 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:36 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e" returned: 0 in 5.223s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:44:36 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Converted 1024.00 MB image at 196.02 MB/s Aug 28 08:44:36 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e is being set with open permissions: ugo+rw Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:36 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e Aug 28 08:44:36 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:36 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e" returned: 0 in 0.243s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" released by "_copy_volume_from_snapshot" :: held 7.711s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7-254558c0-f000-4aaf-83bb-80e02f9f236e" released by "_create_volume_from_snapshot" :: held 7.791s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.815s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.621s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa-cf18af1f-036a-4372-bf89-4cf57b4658b1" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa-cf18af1f-036a-4372-bf89-4cf57b4658b1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Creating volume cf18af1f-036a-4372-bf89-4cf57b4658b1 from snapshot 41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b2df4c-4896-4248-9f0e-2c1441ebe1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254558c0-f000-4aaf-83bb-80e02f9f236e', 'volume_size': 1, 'snapshot_id': '7ec564aa-2908-4b01-ac12-d5053e9e34c7'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db2966c-d47e-4b08-8392-dd7dc71bc428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] snapshot: 41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa, volume: cf18af1f-036a-4372-bf89-4cf57b4658b1, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Volume volume-254558c0-f000-4aaf-83bb-80e02f9f236e (254558c0-f000-4aaf-83bb-80e02f9f236e): created successfully Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db2966c-d47e-4b08-8392-dd7dc71bc428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Flow 'volume_create_manager' (8a3f3d9d-63c4-4614-8ed4-e43a2610e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[344b3a8d-5d7e-4906-b420-c59e2e3d1ed4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-14d9ded3-44df-4154-a6e0-d4929014f9a2 tempest-VolumesDeleteCascade-947953010 None] Created volume successfully. Aug 28 08:44:36 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:36 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:37 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.421s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e78987c-bdcb-4998-baf6-7994699323b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a8284f-a8db-4ba7-9711-9e5c9852b748]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:37 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:37 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-b871ef39-6b35-47b5-8dd2-4d32bd4130f8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-b871ef39-6b35-47b5-8dd2-4d32bd4130f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Performing cascade delete. {{(pid=85762) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-7ec564aa-2908-4b01-ac12-d5053e9e34c7-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-7ec564aa-2908-4b01-ac12-d5053e9e34c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Deleting offline snapshot 7ec564aa-2908-4b01-ac12-d5053e9e34c7 of volume b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] snapshot_file for this snap is: volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959a046-56b1-417d-b2e3-e6d7619dad10]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:37 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:37 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:37 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.429s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:37 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 Aug 28 08:44:37 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:37 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 0.399s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37c36d1-94a7-4034-863c-d52909f8bc03]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:38 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:38 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:39 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 1.249s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:39 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:39 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:40 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 1.080s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:40 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7 Aug 28 08:44:40 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:40 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:40 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:40 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.572s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 8 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:44:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:44:41 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8.7ec564aa-2908-4b01-ac12-d5053e9e34c7" returned: 0 in 0.833s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-7ec564aa-2908-4b01-ac12-d5053e9e34c7" released by "_delete_snapshot" :: held 3.770s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" released by "delete_snapshot" :: held 3.809s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['4ea60b3a-d38c-4819-a8ce-30cb416a795a', '95953b18-2b5f-4b20-aa89-15470525ebfe', '9313aaeb-d665-491e-b9a3-5a2ad0acc8f6', 'cfc13552-c11b-423d-8505-56bae480781f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Delete snapshot completed successfully. Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-7ec564aa-2908-4b01-ac12-d5053e9e34c7-delete_snapshot" released by "delete_snapshot" :: held 4.194s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Snapshots deleted, issuing volume delete {{(pid=85762) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" acquired by "delete_volume" :: waited 0.065s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c18e6-c0d4-40c3-be0e-0e3eeff51c39]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:41 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:41 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:42 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 0.916s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:42 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8 Aug 28 08:44:42 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:43 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" returned: 0 in 0.440s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-b871ef39-6b35-47b5-8dd2-4d32bd4130f8" released by "delete_volume" :: held 1.524s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['42ce6a5d-bb79-4818-85ee-8e8fea74198b', 'b81120d0-1027-4759-b5bd-1e150e82f362', '33168f0f-ff54-42c7-9ddc-9dfa7159646e', '9a5c8cc6-f7b6-401d-966e-08827fcdbda1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:43 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1" returned: 0 in 5.737s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:44:43 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Converted 1024.00 MB image at 178.45 MB/s Aug 28 08:44:43 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:43 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 Aug 28 08:44:43 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:43 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:43 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:43 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" released by "_copy_volume_from_snapshot" :: held 6.968s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa-cf18af1f-036a-4372-bf89-4cf57b4658b1" released by "_create_volume_from_snapshot" :: held 7.051s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.074s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-37db4e98-14c5-4e93-939f-08a02655a5a2 req-fb7a67b7-717b-41b5-b204-d031dcc431e1 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.290s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-37db4e98-14c5-4e93-939f-08a02655a5a2 req-fb7a67b7-717b-41b5-b204-d031dcc431e1 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:43 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.317s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-37db4e98-14c5-4e93-939f-08a02655a5a2 req-fb7a67b7-717b-41b5-b204-d031dcc431e1 tempest-TaggedAttachmentsTest-1534693561 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-6b3b6644-11df-4cc3-b66c-7a433d41304b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a310c2f-d8bc-42ab-a2e2-af987d11f279', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:44:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Deleted volume successfully. Aug 28 08:44:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c43ff824-2197-4f34-9880-b80f08927dc2 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-b871ef39-6b35-47b5-8dd2-4d32bd4130f8-delete_volume" released by "delete_volume" :: held 6.489s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e5373b43-e236-41ec-ac1b-0863171af61b tempest-GroupSnapshotsTest-653247948 None] Create group from source-snapshot-a986c152-cefe-4e2d-b2e4-d22eec825929 completed successfully. Aug 28 08:44:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-37db4e98-14c5-4e93-939f-08a02655a5a2 req-fb7a67b7-717b-41b5-b204-d031dcc431e1 tempest-TaggedAttachmentsTest-1534693561 None] attachment_update completed successfully. Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (6abc6ac8-1da0-42a6-a698-a403ea1870e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea5754-0940-42b5-a518-5ab04846cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea5754-0940-42b5-a518-5ab04846cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1814324790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f155c-d31e-42d9-a5e7-cb6269bdb7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:44Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d295a-62b2-48c5-bc26-26858acffe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d295a-62b2-48c5-bc26-26858acffe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de992e7-0f12-465e-b720-8580a6647fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de992e7-0f12-465e-b720-8580a6647fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38f155c-d31e-42d9-a5e7-cb6269bdb7f1', 'volume_name': 'volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba18c042-44b0-4bd0-8599-3017b5148df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba18c042-44b0-4bd0-8599-3017b5148df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3edb94-4068-44be-8439-79704f6e5115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Volume d38f155c-d31e-42d9-a5e7-cb6269bdb7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1', 'volume_size': 1} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1814324790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f155c-d31e-42d9-a5e7-cb6269bdb7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:44Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Creating volume d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:44 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-254558c0-f000-4aaf-83bb-80e02f9f236e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:44 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 1073741824 Aug 28 08:44:44 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-254558c0-f000-4aaf-83bb-80e02f9f236e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[596935ea-b485-49ab-ae68-5e7373adb24b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d5c59-955e-4dfd-8f50-d78a8be7afe6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:45 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e Aug 28 08:44:45 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:45 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 Aug 28 08:44:45 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:45 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 1073741824" returned: 0 in 0.632s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:45 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 Aug 28 08:44:45 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:45 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e" returned: 0 in 0.531s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:45 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e Aug 28 08:44:45 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:45 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1" returned: 0 in 0.481s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:45 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1 Aug 28 08:44:45 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:45 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3edb94-4068-44be-8439-79704f6e5115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d911cb5-3a4c-4f7a-b66b-f0aaa6760c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:45 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-254558c0-f000-4aaf-83bb-80e02f9f236e" returned: 0 in 0.327s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Volume volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 (d38f155c-d31e-42d9-a5e7-cb6269bdb7f1): created successfully Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d911cb5-3a4c-4f7a-b66b-f0aaa6760c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (6abc6ac8-1da0-42a6-a698-a403ea1870e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-quobyte-254558c0-f000-4aaf-83bb-80e02f9f236e" released by "delete_volume" :: held 0.955s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-74fe1a92-d447-49e2-884a-2d2ef520beec tempest-AttachVolumeTestJSON-217935584 None] Created volume successfully. Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Created reservations ['28bf7efc-9050-4997-b823-c93ce1f4e48f', 'fde9bf9a-81d7-4a86-b700-9fe22ef7df65', '35929e91-ea05-48cb-b844-ee37781ff262', '2e527573-7bcb-440d-a282-e18d56aae6ca'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:45 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cf18af1f-036a-4372-bf89-4cf57b4658b1" returned: 0 in 0.367s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-cf18af1f-036a-4372-bf89-4cf57b4658b1" released by "delete_volume" :: held 0.928s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['8f19d18e-a2f8-4f10-9265-ae65597fd9fb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:46 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:46 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:46 devstack cinder-volume[85762]: WARNING cinder.quota [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1252151737 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1252151737, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:44:46 devstack cinder-volume[85762]: WARNING cinder.quota [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1252151737 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1252151737, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['e6ba5443-451c-4837-b472-f5ab00fcab9c', 'e8d74185-d443-42a5-981d-6a6e89158c73', '48fdfd92-a180-49dd-8195-f682adc23a52', 'd4dbf098-6e65-4d69-8a2f-43a53e2ff96a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:46 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:46 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:46 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.327s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Deleted volume successfully. Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a1cf8-6183-4f26-b6d8-32c04c605688 tempest-VolumesDeleteCascade-947953010 None] Lock "cinder-254558c0-f000-4aaf-83bb-80e02f9f236e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:46 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.302s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-62428261-7dbe-43d4-a65f-f4836a0d4fd5 tempest-GroupSnapshotsTest-653247948 None] Delete group completed successfully. Aug 28 08:44:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-067d2697-7870-4a7a-877a-941147bd0b74 req-f2f8c6c1-220a-4f5d-a6b7-c1df82f272c7 tempest-TaggedAttachmentsTest-1534693561 None] Terminate volume connection completed successfully. Aug 28 08:44:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-067d2697-7870-4a7a-877a-941147bd0b74 req-f2f8c6c1-220a-4f5d-a6b7-c1df82f272c7 tempest-TaggedAttachmentsTest-1534693561 None] Deleting attachment 2a310c2f-d8bc-42ab-a2e2-af987d11f279. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:44:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] group_snapshot a986c152-cefe-4e2d-b2e4-d22eec825929: deleting Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] group_snapshot a986c152-cefe-4e2d-b2e4-d22eec825929: deleting {{(pid=85762) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-1f79c239-9d8e-4b83-bd32-2e422521fb93 req-b0987ccb-94c3-4ac8-b00b-48f2069a6991 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-1f79c239-9d8e-4b83-bd32-2e422521fb93 req-b0987ccb-94c3-4ac8-b00b-48f2069a6991 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-1f79c239-9d8e-4b83-bd32-2e422521fb93 req-b0987ccb-94c3-4ac8-b00b-48f2069a6991 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Deleting offline snapshot 41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa of volume 2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] snapshot_file for this snap is: volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c20fa7-4a5e-43e2-8546-f16319638717]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-1f79c239-9d8e-4b83-bd32-2e422521fb93 req-b0987ccb-94c3-4ac8-b00b-48f2069a6991 tempest-AttachVolumeTestJSON-217935584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad4533b5-a2b7-4d74-b5be-e77e75e2194f', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:44:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-1f79c239-9d8e-4b83-bd32-2e422521fb93 req-b0987ccb-94c3-4ac8-b00b-48f2069a6991 tempest-AttachVolumeTestJSON-217935584 None] attachment_update completed successfully. Aug 28 08:44:47 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:47 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:48 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.720s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e78987c-bdcb-4998-baf6-7994699323b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:44:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea738dd9-5585-4fed-8e40-b90ec3e15798]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:48 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:48 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:49 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.968s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:49 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:49 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:50 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.683s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:50 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa Aug 28 08:44:50 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:50 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9.41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" returned: 0 in 0.470s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-41c4e1bb-89a8-4208-b3c6-55ecbcb5c1aa" released by "_delete_snapshot" :: held 2.999s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" released by "delete_snapshot" :: held 3.048s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:50 devstack cinder-volume[85762]: WARNING cinder.quota [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1252151737 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1252151737, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:44:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['b33cabda-097a-409c-91a1-aace9e28cc20', '4181a1f0-cdba-46ee-a2ee-b79fe327c695', '3bf4ede5-aa5e-465b-af12-7916653963f4', '02bec9ce-e009-4496-97dc-1fd3830dab3b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-39ddd319-bd42-4f07-ba87-b70a8283d051 tempest-GroupSnapshotsTest-653247948 None] group_snapshot a986c152-cefe-4e2d-b2e4-d22eec825929: deleted successfully Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0814101-6177-4801-a4d1-d74e267b6ecf]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:51 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:51 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:51 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.542s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:51 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9 Aug 28 08:44:51 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:52 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2e78987c-bdcb-4998-baf6-7994699323b9" returned: 0 in 0.333s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-2e78987c-bdcb-4998-baf6-7994699323b9" released by "delete_volume" :: held 0.979s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Created reservations ['6c4ac118-fe34-44a0-936f-63925a693da4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:52 devstack cinder-volume[85762]: WARNING cinder.db.api [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1252151737'] Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Created reservations ['8e2f75b3-56be-49d9-b9ae-ba1c97e0833e', '39c1e33b-6a8d-4b44-b22d-0381f0308da4', 'ee38859a-bfeb-4ffa-91b1-582f04024d54', '81a57adf-13b4-450b-907f-af1344c3df4c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:52 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:44:52 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:53 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.412s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:53 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:44:53 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-91f06465-858f-4f20-aa44-7958ead5cc4e tempest-GroupSnapshotsTest-653247948 None] Delete group completed successfully. Aug 28 08:44:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a68e1b34-2743-4a3c-937d-55101eba3e7a tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-379031206: creating Aug 28 08:44:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a68e1b34-2743-4a3c-937d-55101eba3e7a tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-379031206: created successfully Aug 28 08:44:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a68e1b34-2743-4a3c-937d-55101eba3e7a tempest-GroupSnapshotsTest-653247948 None] Create group completed successfully. Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Flow 'volume_create_manager' (8376d8c5-7240-4074-8385-fe6275585ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25256ef0-a275-4ab7-aaf4-f798ed3e834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25256ef0-a275-4ab7-aaf4-f798ed3e834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573215333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3e54b1-6efa-4b0f-8762-7094ed65eb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e3fba3944143c58513d3a21e6ebf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:56Z,use_quota=True,user_id='e0c444b427b44c84a3046a56b318856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c7cafa-e593-4898-8570-e89c05217170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c7cafa-e593-4898-8570-e89c05217170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e7304e-1d2f-47ea-9f39-53a6358bf816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e7304e-1d2f-47ea-9f39-53a6358bf816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3e54b1-6efa-4b0f-8762-7094ed65eb39', 'volume_name': 'volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660c090-66e4-4fa0-96fb-307a9ffe48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660c090-66e4-4fa0-96fb-307a9ffe48e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a56d8e-276d-4ae9-92ba-d9a2f072dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:56 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Volume 4d3e54b1-6efa-4b0f-8762-7094ed65eb39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39', 'volume_size': 1} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573215333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3e54b1-6efa-4b0f-8762-7094ed65eb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e3fba3944143c58513d3a21e6ebf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:56Z,use_quota=True,user_id='e0c444b427b44c84a3046a56b318856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Creating volume 4d3e54b1-6efa-4b0f-8762-7094ed65eb39 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:56 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:44:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:56 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 1073741824 Aug 28 08:44:56 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (f532fea0-45a9-44e2-bb59-f41b670c51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa40e18-e4f8-4794-835b-22f8f3b1b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa40e18-e4f8-4794-835b-22f8f3b1b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-550716587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,host='devstack@QuobyteHD#QuobyteHD',id=ab049d4b-de3e-41fd-9758-24a4973e077a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:57Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17112ddd-4690-43fd-ad3a-659fa1b60296),volume_type_id=17112ddd-4690-43fd-ad3a-659fa1b60296)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc2bd6f-3c30-4351-b837-a8cdb4b68c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc2bd6f-3c30-4351-b837-a8cdb4b68c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3556bd-0c20-42bb-971c-6e703d9ac08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3556bd-0c20-42bb-971c-6e703d9ac08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab049d4b-de3e-41fd-9758-24a4973e077a', 'volume_name': 'volume-ab049d4b-de3e-41fd-9758-24a4973e077a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714f4942-83b6-4156-bf96-dcd5a7efc8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714f4942-83b6-4156-bf96-dcd5a7efc8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71047ade-b0b4-4e0f-bac5-0f4c231933cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:57 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Volume ab049d4b-de3e-41fd-9758-24a4973e077a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab049d4b-de3e-41fd-9758-24a4973e077a', 'volume_size': 1} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:57 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 1073741824" returned: 0 in 1.137s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:57 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 Aug 28 08:44:57 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:58 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" returned: 0 in 0.542s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,created_at=2026-08-28T06:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-550716587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,host='devstack@QuobyteHD#QuobyteHD',id=ab049d4b-de3e-41fd-9758-24a4973e077a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:44:57Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17112ddd-4690-43fd-ad3a-659fa1b60296),volume_type_id=17112ddd-4690-43fd-ad3a-659fa1b60296)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Creating volume ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:44:58 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a56d8e-276d-4ae9-92ba-d9a2f072dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97594cb8-e68f-4b8b-9bbc-5b642fe43a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:58 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a 1073741824 Aug 28 08:44:58 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:58 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Volume volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 (4d3e54b1-6efa-4b0f-8762-7094ed65eb39): created successfully Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97594cb8-e68f-4b8b-9bbc-5b642fe43a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Flow 'volume_create_manager' (8376d8c5-7240-4074-8385-fe6275585ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c8f1fd5c-3599-4745-898e-04bd1ba8998f tempest-VolumesTransfersV357Test-816901437 None] Created volume successfully. Aug 28 08:44:58 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a 1073741824" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:44:58 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a Aug 28 08:44:58 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:44:59 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71047ade-b0b4-4e0f-bac5-0f4c231933cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab049d4b-de3e-41fd-9758-24a4973e077a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6738af19-513e-47e9-84ef-ea082626e447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:44:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Volume volume-ab049d4b-de3e-41fd-9758-24a4973e077a (ab049d4b-de3e-41fd-9758-24a4973e077a): created successfully Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6738af19-513e-47e9-84ef-ea082626e447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:44:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (f532fea0-45a9-44e2-bb59-f41b670c51cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:44:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-753dd8a8-1a6d-4ea6-90a3-fd3635f4932a tempest-GroupSnapshotsTest-653247948 None] Created volume successfully. Aug 28 08:45:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4cc77890-e8ab-44b9-aba6-2180742f7a26 tempest-VolumesTransfersV357Test-860929745 None] Transfer volume completed successfully. Aug 28 08:45:00 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:45:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (d867d184-1d99-4dd0-93aa-0c1a3dedd63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7960f-3b4f-49c2-bb52-1558bb5d897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb7960f-3b4f-49c2-bb52-1558bb5d897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566144354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,host='devstack@QuobyteHD#QuobyteHD',id=3aa8f24e-9f81-4a33-852a-8508a5ee6171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:01Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17112ddd-4690-43fd-ad3a-659fa1b60296),volume_type_id=17112ddd-4690-43fd-ad3a-659fa1b60296)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe23314-7e05-4e25-adb8-657e83b755fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe23314-7e05-4e25-adb8-657e83b755fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc3e5c0-7eb5-4bed-bb3c-5f23eb294191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc3e5c0-7eb5-4bed-bb3c-5f23eb294191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa8f24e-9f81-4a33-852a-8508a5ee6171', 'volume_name': 'volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb1ae8-a55c-4fc3-9b06-c8247363239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb1ae8-a55c-4fc3-9b06-c8247363239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bdacda-365b-453c-867e-1404907bce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Volume 3aa8f24e-9f81-4a33-852a-8508a5ee6171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171', 'volume_size': 1} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,created_at=2026-08-28T06:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566144354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a3a0beb-b62a-4d44-8542-0637fa678e97,host='devstack@QuobyteHD#QuobyteHD',id=3aa8f24e-9f81-4a33-852a-8508a5ee6171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:01Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17112ddd-4690-43fd-ad3a-659fa1b60296),volume_type_id=17112ddd-4690-43fd-ad3a-659fa1b60296)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Creating volume 3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:45:01 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:01 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 1073741824 Aug 28 08:45:01 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "cinder-4d3e54b1-6efa-4b0f-8762-7094ed65eb39-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-4d3e54b1-6efa-4b0f-8762-7094ed65eb39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "cinder-quobyte-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-quobyte-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e85297-57cd-4dfb-821b-ef07577732c8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:01 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 Aug 28 08:45:01 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:01 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 1073741824" returned: 0 in 0.840s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:02 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 Aug 28 08:45:02 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:02 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" returned: 0 in 0.605s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:02 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171" returned: 0 in 0.367s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:02 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39 Aug 28 08:45:02 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bdacda-365b-453c-867e-1404907bce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08588b8-4c2f-426d-a888-38be21e2dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Volume volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 (3aa8f24e-9f81-4a33-852a-8508a5ee6171): created successfully Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08588b8-4c2f-426d-a888-38be21e2dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (d867d184-1d99-4dd0-93aa-0c1a3dedd63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8c20def6-6068-4f8e-b562-98555b7a8355 tempest-GroupSnapshotsTest-653247948 None] Created volume successfully. Aug 28 08:45:02 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "cinder-6b3b6644-11df-4cc3-b66c-7a433d41304b-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" returned: 0 in 0.416s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-quobyte-4d3e54b1-6efa-4b0f-8762-7094ed65eb39" released by "delete_volume" :: held 1.082s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "cinder-6b3b6644-11df-4cc3-b66c-7a433d41304b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "cinder-quobyte-6b3b6644-11df-4cc3-b66c-7a433d41304b" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "cinder-quobyte-6b3b6644-11df-4cc3-b66c-7a433d41304b" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Created reservations ['f875d586-2e16-4569-8bd9-5c241083e465', '72c3da5f-bdcf-4efd-986f-b759d94ba2d7', '4bfc0ae3-4796-4027-a3e7-01b5f106b635', '4aef8ded-26e2-4b79-85bb-271fc3759327'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af921b-85a7-44a5-ba05-9c03f8645614]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:03 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:03 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:03 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:03 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:03 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b" returned: 0 in 0.425s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:03 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.311s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:03 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b Aug 28 08:45:03 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Deleted volume successfully. Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b02de686-8ed0-4a8f-8676-da602fdce0c2 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-4d3e54b1-6efa-4b0f-8762-7094ed65eb39-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eed99ac7-bf74-4640-aad7-b0bb69e4f134 tempest-GroupSnapshotsTest-653247948 None] Update group completed successfully. Aug 28 08:45:03 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6b3b6644-11df-4cc3-b66c-7a433d41304b" returned: 0 in 0.334s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "cinder-quobyte-6b3b6644-11df-4cc3-b66c-7a433d41304b" released by "delete_volume" :: held 0.819s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Created reservations ['7f41d535-2a16-4259-bb0c-b19e19ba4982', '85da6c80-0215-4929-9f46-39eae4b9ef02', '0cf39c7c-ed35-4587-a808-e739f3c7d2bc', '3cef7831-252d-479b-ab58-ee0d4767a310'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:03 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:03 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:04 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.415s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:04 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Deleted volume successfully. Aug 28 08:45:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7dc1bca1-d04e-429c-a3a4-f0b927e22cd9 tempest-TaggedAttachmentsTest-1534693561 None] Lock "cinder-6b3b6644-11df-4cc3-b66c-7a433d41304b-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Flow 'volume_create_manager' (71d7eddb-eda1-49b2-b377-b47870b104ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1f80a1-4cdb-4de1-9782-8492c86d4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1ab9926e-b2e6-4cf1-a456-fe5f06c0a5ef tempest-GroupSnapshotsTest-653247948 None] Update group completed successfully. Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1f80a1-4cdb-4de1-9782-8492c86d4da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822106605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356ff6b4-5240-4156-a47c-abc3edf4e01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e3fba3944143c58513d3a21e6ebf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:05Z,use_quota=True,user_id='e0c444b427b44c84a3046a56b318856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d27ba-2429-4627-81cb-fbc291c565f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d27ba-2429-4627-81cb-fbc291c565f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf426351-8d71-4e2b-98f9-87bbe082fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf426351-8d71-4e2b-98f9-87bbe082fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356ff6b4-5240-4156-a47c-abc3edf4e01f', 'volume_name': 'volume-356ff6b4-5240-4156-a47c-abc3edf4e01f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ad31f-cf30-4a53-9d43-55df306fea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ad31f-cf30-4a53-9d43-55df306fea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2535b341-b73a-43ed-a107-da07ba9820db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Volume 356ff6b4-5240-4156-a47c-abc3edf4e01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356ff6b4-5240-4156-a47c-abc3edf4e01f', 'volume_size': 1} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822106605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356ff6b4-5240-4156-a47c-abc3edf4e01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e3fba3944143c58513d3a21e6ebf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:05Z,use_quota=True,user_id='e0c444b427b44c84a3046a56b318856b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Creating volume 356ff6b4-5240-4156-a47c-abc3edf4e01f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:45:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:05 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f 1073741824 Aug 28 08:45:05 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:05 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f 1073741824" returned: 0 in 0.590s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:05 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f Aug 28 08:45:05 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:06 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f" returned: 0 in 0.493s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2535b341-b73a-43ed-a107-da07ba9820db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356ff6b4-5240-4156-a47c-abc3edf4e01f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343dd801-2046-44c6-a45a-a437883791ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Volume volume-356ff6b4-5240-4156-a47c-abc3edf4e01f (356ff6b4-5240-4156-a47c-abc3edf4e01f): created successfully Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343dd801-2046-44c6-a45a-a437883791ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Flow 'volume_create_manager' (71d7eddb-eda1-49b2-b377-b47870b104ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-15e27223-24f5-481f-945b-6af5eb4e91fe tempest-VolumesTransfersV357Test-816901437 None] Created volume successfully. Aug 28 08:45:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-86778426-bf73-4da5-9cd4-bb77575529ad tempest-GroupSnapshotsTest-653247948 None] Update group completed successfully. Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "cinder-356ff6b4-5240-4156-a47c-abc3edf4e01f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-356ff6b4-5240-4156-a47c-abc3edf4e01f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "cinder-quobyte-356ff6b4-5240-4156-a47c-abc3edf4e01f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-quobyte-356ff6b4-5240-4156-a47c-abc3edf4e01f" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a2d96-f8bc-4380-bdcb-b8927f3c8871]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:07 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f Aug 28 08:45:07 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d3a23fdd-b4f5-415b-8d88-cffa4629d50b tempest-GroupSnapshotsTest-653247948 None] Update group completed successfully. Aug 28 08:45:08 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f" returned: 0 in 0.553s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:08 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f Aug 28 08:45:08 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:08 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-356ff6b4-5240-4156-a47c-abc3edf4e01f" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-quobyte-356ff6b4-5240-4156-a47c-abc3edf4e01f" released by "delete_volume" :: held 0.887s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=126,cinder:INSERT=28,cinder:UPDATE=125,cinder:DELETE=7 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=125,cinder:UPDATE=123,cinder:DELETE=8,cinder:INSERT=29 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Created reservations ['476cc65f-2af7-4bc9-9c50-8db76bf11736', '407e0139-aecb-4f36-a26d-2be647e91366', '29b7495b-4660-4c4c-9405-3ce6390f97bd', '54541e35-056f-4d83-8c39-98f7f5355b2f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:08 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:08 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:09 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:09 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Deleted volume successfully. Aug 28 08:45:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d75b142-16aa-4cb9-9b3a-6050e4872495 tempest-VolumesTransfersV357Test-1825865302 None] Lock "cinder-356ff6b4-5240-4156-a47c-abc3edf4e01f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] GroupSnapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: creating. Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Group snapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: creating. {{(pid=85762) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Creating offline snapshot 0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef of volume 3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffe7dee-d0b5-421b-a9b4-7e9e3c4f5d17]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:10 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 Aug 28 08:45:10 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:11 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171" returned: 0 in 0.810s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:11 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef 1G Aug 28 08:45:11 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:11 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef 1G" returned: 0 in 0.701s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:11 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef Aug 28 08:45:11 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:12 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" returned: 0 in 0.440s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:12 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:12 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef Aug 28 08:45:12 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:12 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" returned: 0 in 0.445s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:12 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info Aug 28 08:45:12 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:13 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info" returned: 0 in 0.451s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:13 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:13 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info Aug 28 08:45:13 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:13 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.info" returned: 0 in 0.407s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.499s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Creating offline snapshot 407a6fb7-974a-44d3-a233-1e843f4b3c30 of volume ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23a75e-0956-4ae6-b97e-6623a34979d4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:13 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a Aug 28 08:45:13 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:14 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a" returned: 0 in 0.442s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:14 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 1G Aug 28 08:45:14 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:14 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 1G" returned: 0 in 0.604s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab049d4b-de3e-41fd-9758-24a4973e077a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:14 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab049d4b-de3e-41fd-9758-24a4973e077a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 Aug 28 08:45:14 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:15 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab049d4b-de3e-41fd-9758-24a4973e077a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30" returned: 0 in 0.436s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:15 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:15 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 Aug 28 08:45:15 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:15 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:15 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info Aug 28 08:45:15 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:15 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info" returned: 0 in 0.323s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:15 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:15 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info Aug 28 08:45:15 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:16 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.info" returned: 0 in 0.308s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-27dcb874-c06b-4d1c-a868-b00d00c69d21 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: created successfully Aug 28 08:45:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: deleting Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: deleting {{(pid=85762) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Deleting offline snapshot 0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef of volume 3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:45:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] snapshot_file for this snap is: volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[20689688-afce-4c9d-9a4e-c9b872ff0785]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:17 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef Aug 28 08:45:17 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:17 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef572d-4d95-484a-83f6-a34384917942]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:17 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 Aug 28 08:45:17 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:18 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171" returned: 0 in 0.563s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:18 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef Aug 28 08:45:18 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:18 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" returned: 0 in 0.586s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:18 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef Aug 28 08:45:18 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:19 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171.0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" returned: 0 in 0.347s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-0f9eb4e3-906e-4ab5-b04d-e0165a6f04ef" released by "_delete_snapshot" :: held 2.234s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" released by "delete_snapshot" :: held 2.269s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-407a6fb7-974a-44d3-a233-1e843f4b3c30" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-407a6fb7-974a-44d3-a233-1e843f4b3c30" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Deleting offline snapshot 407a6fb7-974a-44d3-a233-1e843f4b3c30 of volume ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] snapshot_file for this snap is: volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d6a50a-777a-412e-bc6c-fbf929291d52]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:19 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 Aug 28 08:45:19 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:19 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30" returned: 0 in 0.625s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab049d4b-de3e-41fd-9758-24a4973e077a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:45:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4161439-2c1a-4bdd-b68b-844ea3fa5b40]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:20 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a Aug 28 08:45:20 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:20 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a" returned: 0 in 0.722s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:20 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 Aug 28 08:45:20 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-02e4bfc4-fbd2-4e86-a1a8-3eb075b60bdc req-e2c99dce-11b2-4e38-b935-04ec80dca9d3 tempest-AttachVolumeTestJSON-217935584 None] Terminate volume connection completed successfully. Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-02e4bfc4-fbd2-4e86-a1a8-3eb075b60bdc req-e2c99dce-11b2-4e38-b935-04ec80dca9d3 tempest-AttachVolumeTestJSON-217935584 None] Deleting attachment ad4533b5-a2b7-4d74-b5be-e77e75e2194f. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:45:21 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30" returned: 0 in 0.670s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:21 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30 Aug 28 08:45:21 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:21 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a.407a6fb7-974a-44d3-a233-1e843f4b3c30" returned: 0 in 0.455s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-407a6fb7-974a-44d3-a233-1e843f4b3c30" released by "_delete_snapshot" :: held 2.654s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" released by "delete_snapshot" :: held 2.696s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:22 devstack cinder-volume[85762]: WARNING cinder.quota [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1936015713 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1936015713, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:22 devstack cinder-volume[85762]: WARNING cinder.quota [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1936015713 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1936015713, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:22 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['875f6221-2f38-4232-a6bb-c592185ff427', '355970a0-2210-498f-8362-4114a909897b', 'cd75e312-5f95-466a-8ca9-72074c1ad29b', '776767d1-71b4-447e-8aa8-27ed079b29ed'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:22 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['f4b8a757-3298-4b45-a7d9-229c300d1273', 'bf159ae5-e6cf-4c87-9b14-82c81fe7f36d', 'a96e3967-c1f2-40b2-87aa-891966385b4a', '40e21b08-5a6a-46fb-a6f3-f369769e0519'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-53cbb9e8-efe9-4ac7-85d1-6d3009962519 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 933d154f-22a5-4571-a471-97e2fbabc7e2: deleted successfully Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0dcdc9-ff09-48e0-8fd5-6ad78eaefc8a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:23 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 Aug 28 08:45:23 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:23 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171" returned: 0 in 0.529s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:23 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171 Aug 28 08:45:23 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:24 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3aa8f24e-9f81-4a33-852a-8508a5ee6171" returned: 0 in 0.281s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-3aa8f24e-9f81-4a33-852a-8508a5ee6171" released by "delete_volume" :: held 0.897s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb69830-a6e8-404b-b08b-b01e8af63524]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:24 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a Aug 28 08:45:24 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:24 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a" returned: 0 in 0.494s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:24 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a Aug 28 08:45:24 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:25 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ab049d4b-de3e-41fd-9758-24a4973e077a" returned: 0 in 0.289s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-ab049d4b-de3e-41fd-9758-24a4973e077a" released by "delete_volume" :: held 0.858s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Created reservations ['39e0cd99-eb0c-4ac9-925d-ddb6a1f74fe4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:25 devstack cinder-volume[85762]: WARNING cinder.quota [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1936015713 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1936015713, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Created reservations ['f922cb21-84f9-436a-9ffe-e1c8b6203a99', 'd86abed3-bb2b-42dc-86e8-a41e7443ae9e', 'b7d4835c-67d9-4a05-9112-8933c5eb1787', '64860bc1-632a-427c-8900-09b0cd19a56e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Created reservations ['f05d879a-d6b6-41d5-b5e7-73a6712cd300', 'db3051d2-6bf3-4f7e-a26b-93d09a96c15d', 'e4530e33-6a0a-4f85-9c54-0722104c5b26', 'c409630c-935b-46d2-b9d0-dea696671e75'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:25 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:25 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:26 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:26 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6105d8f9-5ca1-4e9d-a4a1-20432658c10f tempest-GroupSnapshotsTest-653247948 None] Delete group completed successfully. Aug 28 08:45:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eac8553f-a4aa-4801-973e-a9a7d824795f tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-352617373: creating Aug 28 08:45:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eac8553f-a4aa-4801-973e-a9a7d824795f tempest-GroupSnapshotsTest-653247948 None] Group tempest-GroupSnapshotsTest-Group-352617373: created successfully Aug 28 08:45:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eac8553f-a4aa-4801-973e-a9a7d824795f tempest-GroupSnapshotsTest-653247948 None] Create group completed successfully. Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (243cefd8-999b-4001-8e8e-41daf9c8c12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae18f5a1-d314-4309-bc91-1b865e39769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae18f5a1-d314-4309-bc91-1b865e39769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383696616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fffb2b75-d5f1-4823-9965-3f43850f01d7,host='devstack@QuobyteHD#QuobyteHD',id=1f0874a6-5576-4f4a-90f8-e00ae70976e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:28Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d82385d-5ffc-437c-b6d7-ded7d8f6ce80),volume_type_id=5d82385d-5ffc-437c-b6d7-ded7d8f6ce80)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f8eb40-2b8a-45ff-b7e3-fafdedae8a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f8eb40-2b8a-45ff-b7e3-fafdedae8a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22155f57-d2d5-422d-9dfb-cf4551323df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22155f57-d2d5-422d-9dfb-cf4551323df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0874a6-5576-4f4a-90f8-e00ae70976e1', 'volume_name': 'volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5ce077-5d81-4806-9ab1-3d5670785aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5ce077-5d81-4806-9ab1-3d5670785aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc83ca49-7fb9-49ed-a583-61404e198199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Volume 1f0874a6-5576-4f4a-90f8-e00ae70976e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1', 'volume_size': 1} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fffb2b75-d5f1-4823-9965-3f43850f01d7,created_at=2026-08-28T06:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383696616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fffb2b75-d5f1-4823-9965-3f43850f01d7,host='devstack@QuobyteHD#QuobyteHD',id=1f0874a6-5576-4f4a-90f8-e00ae70976e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074b62e2d5cf41509cb19d9744fb3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:28Z,use_quota=True,user_id='1e40e632fc084e419df79bab77946c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d82385d-5ffc-437c-b6d7-ded7d8f6ce80),volume_type_id=5d82385d-5ffc-437c-b6d7-ded7d8f6ce80)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Creating volume 1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:45:28 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:45:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:28 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 1073741824 Aug 28 08:45:28 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:29 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 1073741824" returned: 0 in 0.578s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:29 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 Aug 28 08:45:29 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:29 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc83ca49-7fb9-49ed-a583-61404e198199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db01b43-6042-4eb8-957e-573d5422c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Volume volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 (1f0874a6-5576-4f4a-90f8-e00ae70976e1): created successfully Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db01b43-6042-4eb8-957e-573d5422c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Flow 'volume_create_manager' (243cefd8-999b-4001-8e8e-41daf9c8c12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0faa5395-3a99-416c-ad18-a2ea2405d7c2 tempest-GroupSnapshotsTest-653247948 None] Created volume successfully. Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Flow 'volume_create_manager' (57846c15-e5e5-4d08-9dbf-e3905ac52792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04addd19-305c-4451-b864-5d33de0b3a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04addd19-305c-4451-b864-5d33de0b3a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9948799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55718470bbb043e1a755030c5a9f7bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:31Z,use_quota=True,user_id='c099b4c2682a4ebfb22817c6b1ccbfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fa3538-7d8a-4e15-abc5-cf9ba36fb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fa3538-7d8a-4e15-abc5-cf9ba36fb014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6b3f55-313d-45bb-84f5-70071401c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6b3f55-313d-45bb-84f5-70071401c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a', 'volume_name': 'volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19b79bf-c9d6-4246-a895-a39fc07ca997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19b79bf-c9d6-4246-a895-a39fc07ca997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc063aa-2dfd-4801-91b4-c0478801a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:31 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a', 'volume_size': 1} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9948799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55718470bbb043e1a755030c5a9f7bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:31Z,use_quota=True,user_id='c099b4c2682a4ebfb22817c6b1ccbfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Creating volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:45:31 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:31 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a 1073741824 Aug 28 08:45:31 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] GroupSnapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: creating. Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Group snapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: creating. {{(pid=85762) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 08:45:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:32 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a 1073741824" returned: 0 in 0.827s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:32 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:45:32 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:32 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.391s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc063aa-2dfd-4801-91b4-c0478801a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72791407-34f9-4502-a4dc-b5e40838b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Creating offline snapshot e541309d-f036-4b56-a7ca-ada7c65bd33c of volume 1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:45:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Volume volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a (7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a): created successfully Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72791407-34f9-4502-a4dc-b5e40838b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Flow 'volume_create_manager' (57846c15-e5e5-4d08-9dbf-e3905ac52792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91eaa2-a166-4721-ad70-50f7fe5e36d6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-03cbb1ea-58cd-4539-aa66-21194b796c2c tempest-VolumesActionsTest-1103369095 None] Created volume successfully. Aug 28 08:45:33 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 Aug 28 08:45:33 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:33 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1" returned: 0 in 0.573s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:33 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c 1G Aug 28 08:45:33 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:34 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c 1G" returned: 0 in 0.928s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:34 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c Aug 28 08:45:34 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:34 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c" returned: 0 in 0.613s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:35 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:35 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c Aug 28 08:45:35 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:35 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c" returned: 0 in 0.334s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:35 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info Aug 28 08:45:35 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:35 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info" returned: 0 in 0.516s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:35 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:45:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:35 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info Aug 28 08:45:35 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:36 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.info" returned: 0 in 0.734s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.987s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-31704004-d29d-4309-97de-ea1daebd0a9f tempest-GroupSnapshotsTest-653247948 None] group_snapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: created successfully Aug 28 08:45:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: deleting Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: deleting {{(pid=85762) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-e541309d-f036-4b56-a7ca-ada7c65bd33c" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-e541309d-f036-4b56-a7ca-ada7c65bd33c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Deleting offline snapshot e541309d-f036-4b56-a7ca-ada7c65bd33c of volume 1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] snapshot_file for this snap is: volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed06c1-ffe1-45ff-9fc5-70c852d49a17]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:38 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c Aug 28 08:45:38 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:38 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c" returned: 0 in 0.871s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:45:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a8aa72-c054-404f-8d2e-809c34e136b3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:39 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 Aug 28 08:45:39 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:39 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1" returned: 0 in 0.958s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:39 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c Aug 28 08:45:39 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:40 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:40 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:40 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c" returned: 0 in 0.796s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:40 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c Aug 28 08:45:40 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:40 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.508s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 8 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:45:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:45:41 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1.e541309d-f036-4b56-a7ca-ada7c65bd33c" returned: 0 in 0.528s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-e541309d-f036-4b56-a7ca-ada7c65bd33c" released by "_delete_snapshot" :: held 3.431s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" released by "delete_snapshot" :: held 3.491s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:41 devstack cinder-volume[85762]: WARNING cinder.quota [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-148268823 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-148268823, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:41 devstack cinder-volume[85762]: WARNING cinder.quota [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-148268823 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-148268823, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['3670cf9d-fdb1-4c40-9c87-34bd3a159f94', '3bc22554-9f49-42d8-ab74-4a31c1cbfd56', 'f3f5171f-5d75-4713-a130-2db0678fadf3', '6c2941ca-133a-41a1-a608-e81e9868b130'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-caf72415-7755-48aa-a2d7-4af5f43a84b7 tempest-GroupSnapshotsTest-653247948 None] group_snapshot 866c4282-ca46-4c58-a8c2-ff48b7936fb3: deleted successfully Aug 28 08:45:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" acquired by "delete_volume" :: waited 0.047s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c5bba4-0952-4826-816f-7612782119b0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:45:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:42 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 Aug 28 08:45:42 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:43 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1" returned: 0 in 0.600s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:43 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1 Aug 28 08:45:43 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:43 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f0874a6-5576-4f4a-90f8-e00ae70976e1" returned: 0 in 0.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Lock "cinder-quobyte-1f0874a6-5576-4f4a-90f8-e00ae70976e1" released by "delete_volume" :: held 1.129s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['23d253ca-c63e-4a4d-a6a5-476aa471a14a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:43 devstack cinder-volume[85762]: WARNING cinder.quota [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-148268823 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-148268823, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:45:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Created reservations ['368124e0-cb47-4207-9b06-ad0d4d928805', 'b09d220b-0a48-4502-8928-ff012b972eff', 'a94e0649-ef27-4c71-84a0-cda2237d158c', '764c530d-894a-4d03-b500-ef1457c32ff9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:44 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:45:44 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:44 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.459s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:44 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:45:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5878ca58-2c3c-4f19-82aa-5b248be6e0b6 tempest-GroupSnapshotsTest-653247948 None] Delete group completed successfully. Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-390af8b7-ed8f-4830-b3b5-ffbebdd5ec7c tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" by "attach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-390af8b7-ed8f-4830-b3b5-ffbebdd5ec7c tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" acquired by "attach_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-390af8b7-ed8f-4830-b3b5-ffbebdd5ec7c tempest-VolumesActionsTest-1103369095 None] Attaching volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a to instance bd5c14c0-ad2c-4c0b-91d9-43f786c98174 at mountpoint /dev/vdb on host None. Aug 28 08:45:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-390af8b7-ed8f-4830-b3b5-ffbebdd5ec7c tempest-VolumesActionsTest-1103369095 None] Attach volume completed successfully. Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-390af8b7-ed8f-4830-b3b5-ffbebdd5ec7c tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" released by "attach_volume" :: held 0.206s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ec3c8027-7e36-4df9-8fb0-ec970c7583fe tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" by "detach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ec3c8027-7e36-4df9-8fb0-ec970c7583fe tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:45:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ec3c8027-7e36-4df9-8fb0-ec970c7583fe tempest-VolumesActionsTest-1103369095 None] Detaching volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a from instance bd5c14c0-ad2c-4c0b-91d9-43f786c98174. Aug 28 08:45:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ec3c8027-7e36-4df9-8fb0-ec970c7583fe tempest-VolumesActionsTest-1103369095 None] Detach volume completed successfully. Aug 28 08:45:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ec3c8027-7e36-4df9-8fb0-ec970c7583fe tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:45:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-28202202-a2c2-4117-9975-ea0b2b7f066a tempest-GroupSnapshotsV319Test-908337211 None] Group tempest-GroupSnapshotsV319Test-Group-1668619207: creating Aug 28 08:45:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-28202202-a2c2-4117-9975-ea0b2b7f066a tempest-GroupSnapshotsV319Test-908337211 None] Group tempest-GroupSnapshotsV319Test-Group-1668619207: created successfully Aug 28 08:45:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-28202202-a2c2-4117-9975-ea0b2b7f066a tempest-GroupSnapshotsV319Test-908337211 None] Create group completed successfully. Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Flow 'volume_create_manager' (e9dd2360-7343-4a81-91e5-2f6917ae8df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e483a73e-e644-423c-bf73-0ce1464095aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e483a73e-e644-423c-bf73-0ce1464095aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465082352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f6c153a-f96b-4a2c-86f2-56ed56ade823,host='devstack@QuobyteHD#QuobyteHD',id=8c477adf-0804-4e11-9a92-c1862e23b307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00c97f59e94675b1610721e1c115c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:59Z,use_quota=True,user_id='fa4cd112c8f340fe8b9c3bcf388ad136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743e21af-3fc9-4378-93e2-839faa307b6d),volume_type_id=743e21af-3fc9-4378-93e2-839faa307b6d)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7661db7-9c6a-49cd-bb9d-06264926bc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7661db7-9c6a-49cd-bb9d-06264926bc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bafcd0-6490-4f6a-a288-22276c784e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bafcd0-6490-4f6a-a288-22276c784e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c477adf-0804-4e11-9a92-c1862e23b307', 'volume_name': 'volume-8c477adf-0804-4e11-9a92-c1862e23b307', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fb3350-4634-484b-8312-5b6975bdb581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fb3350-4634-484b-8312-5b6975bdb581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dca7e53-7467-4a9d-b505-8eb50279e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:45:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Volume 8c477adf-0804-4e11-9a92-c1862e23b307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c477adf-0804-4e11-9a92-c1862e23b307', 'volume_size': 1} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f6c153a-f96b-4a2c-86f2-56ed56ade823,created_at=2026-08-28T06:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465082352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f6c153a-f96b-4a2c-86f2-56ed56ade823,host='devstack@QuobyteHD#QuobyteHD',id=8c477adf-0804-4e11-9a92-c1862e23b307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00c97f59e94675b1610721e1c115c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:45:59Z,use_quota=True,user_id='fa4cd112c8f340fe8b9c3bcf388ad136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743e21af-3fc9-4378-93e2-839faa307b6d),volume_type_id=743e21af-3fc9-4378-93e2-839faa307b6d)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Creating volume 8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:45:59 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:59 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 1073741824 Aug 28 08:45:59 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:45:59 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 1073741824" returned: 0 in 0.640s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:45:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:45:59 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 Aug 28 08:45:59 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:00 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dca7e53-7467-4a9d-b505-8eb50279e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c477adf-0804-4e11-9a92-c1862e23b307', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b552e5e9-c9b5-46f5-acfe-3f67f3a7d1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Volume volume-8c477adf-0804-4e11-9a92-c1862e23b307 (8c477adf-0804-4e11-9a92-c1862e23b307): created successfully Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b552e5e9-c9b5-46f5-acfe-3f67f3a7d1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Flow 'volume_create_manager' (e9dd2360-7343-4a81-91e5-2f6917ae8df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:46:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-36f70aaa-31b7-47be-9806-b34beeeb7979 tempest-GroupSnapshotsV319Test-908337211 None] Created volume successfully. Aug 28 08:46:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] GroupSnapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: creating. Aug 28 08:46:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Group snapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: creating. {{(pid=85762) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Creating offline snapshot ddbea733-e273-4813-8e3b-75dda1de9de9 of volume 8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf90ba-b2e9-4717-9c98-15a62beb4ec4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:02 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 Aug 28 08:46:02 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:02 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307" returned: 0 in 0.715s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:02 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 1G Aug 28 08:46:02 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 1G" returned: 0 in 0.775s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c477adf-0804-4e11-9a92-c1862e23b307 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:03 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:03 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c477adf-0804-4e11-9a92-c1862e23b307 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 Aug 28 08:46:03 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:04 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c477adf-0804-4e11-9a92-c1862e23b307 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9" returned: 0 in 1.100s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:04 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:46:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:04 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 Aug 28 08:46:04 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:05 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9" returned: 0 in 0.740s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:05 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info Aug 28 08:46:05 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:06 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info" returned: 0 in 0.675s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:06 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 08:46:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:06 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info Aug 28 08:46:06 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:06 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.info" returned: 0 in 0.547s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:46:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-23d3feae-2e9e-48de-929b-26a76a96858b tempest-GroupSnapshotsV319Test-908337211 None] group_snapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: created successfully Aug 28 08:46:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] group_snapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: deleting Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] group_snapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: deleting {{(pid=85762) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "cinder-quobyte-ddbea733-e273-4813-8e3b-75dda1de9de9" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-ddbea733-e273-4813-8e3b-75dda1de9de9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Deleting offline snapshot ddbea733-e273-4813-8e3b-75dda1de9de9 of volume 8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] snapshot_file for this snap is: volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7d46ce-7c32-4608-98b1-17de39003dec]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:08 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 Aug 28 08:46:08 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:09 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9" returned: 0 in 0.639s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c477adf-0804-4e11-9a92-c1862e23b307(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:46:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75851e3-00b0-47e4-b381-72589847f64d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:09 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 Aug 28 08:46:09 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:10 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307" returned: 0 in 0.677s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:10 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 Aug 28 08:46:10 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:10 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9" returned: 0 in 0.589s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:10 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9 Aug 28 08:46:10 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:11 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307.ddbea733-e273-4813-8e3b-75dda1de9de9" returned: 0 in 0.475s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-ddbea733-e273-4813-8e3b-75dda1de9de9" released by "_delete_snapshot" :: held 2.585s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" released by "delete_snapshot" :: held 2.638s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=72,cinder:SELECT=75,cinder:DELETE=2,cinder:INSERT=20 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=88,cinder:INSERT=19,cinder:UPDATE=83,cinder:DELETE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:46:11 devstack cinder-volume[85762]: WARNING cinder.quota [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-773694910 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-773694910, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:46:11 devstack cinder-volume[85762]: WARNING cinder.quota [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-773694910 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-773694910, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:46:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] Created reservations ['391eb733-f751-4f55-b20f-57474ad82721', '9efee239-34e9-442a-b30d-50a1d7b93daa', '9896d1a0-7969-4d83-962d-066e6d708dc4', '4a63ea8d-891c-42cf-95af-43b5a40907ae'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:46:11 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-878748ae-d4f7-417d-b2c9-7093f66d8660 tempest-GroupSnapshotsV319Test-908337211 None] group_snapshot bb1220a3-6913-42a6-89cf-ffa74a56f355: deleted successfully Aug 28 08:46:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:46:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:46:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d537b6-2e06-4725-bb1f-108c4928d0c5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:13 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 Aug 28 08:46:13 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:14 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307" returned: 0 in 0.999s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:14 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307 Aug 28 08:46:14 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:14 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8c477adf-0804-4e11-9a92-c1862e23b307" returned: 0 in 0.494s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Lock "cinder-quobyte-8c477adf-0804-4e11-9a92-c1862e23b307" released by "delete_volume" :: held 1.626s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Created reservations ['60c99129-6dba-46f8-b5e4-899e2e8f5e8b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:46:15 devstack cinder-volume[85762]: WARNING cinder.quota [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-773694910 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-773694910, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Created reservations ['f2fa9ca3-f62d-4aa5-97ec-be34eff48cee', '73a6da3d-b313-4248-823e-53dd87db9047', 'dd4fec7f-7409-42a3-adf3-c3510e7c665b', 'b70e3cd3-bd92-4385-849f-5f96a3c6eed6'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:46:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:15 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:46:15 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:16 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.049s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:16 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:46:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e5a63376-f9df-4dd4-87ea-bf784d591052 tempest-GroupSnapshotsV319Test-908337211 None] Delete group completed successfully. Aug 28 08:46:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a9b9febe-0d4e-4fdd-aedb-c99af3775988 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" by "attach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:46:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a9b9febe-0d4e-4fdd-aedb-c99af3775988 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" acquired by "attach_volume" :: waited 0.050s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:46:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a9b9febe-0d4e-4fdd-aedb-c99af3775988 tempest-VolumesActionsTest-1103369095 None] Attaching volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a to instance 68e5d962-5d06-4a6f-9cdd-14ee9cde99bc at mountpoint /dev/vdb on host None. Aug 28 08:46:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a9b9febe-0d4e-4fdd-aedb-c99af3775988 tempest-VolumesActionsTest-1103369095 None] Attach volume completed successfully. Aug 28 08:46:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a9b9febe-0d4e-4fdd-aedb-c99af3775988 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" released by "attach_volume" :: held 0.296s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:46:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0deda572-3d09-43b2-ad4b-ff04017cf552 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" by "detach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:46:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0deda572-3d09-43b2-ad4b-ff04017cf552 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" acquired by "detach_volume" :: waited 0.072s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:46:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0deda572-3d09-43b2-ad4b-ff04017cf552 tempest-VolumesActionsTest-1103369095 None] Detaching volume 7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a from instance 68e5d962-5d06-4a6f-9cdd-14ee9cde99bc. Aug 28 08:46:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0deda572-3d09-43b2-ad4b-ff04017cf552 tempest-VolumesActionsTest-1103369095 None] Detach volume completed successfully. Aug 28 08:46:19 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0deda572-3d09-43b2-ad4b-ff04017cf552 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:46:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:46:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a10743d-44f3-43c3-84fe-bea08b343c94]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:29 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:46:29 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:29 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.594s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640298e-de9e-4499-a079-2a93d76bda15]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:30 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:46:30 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:30 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.482s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.f0bd3365-14eb-46a9-ade3-e36062b3437f_xggour2.img {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:30 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.f0bd3365-14eb-46a9-ade3-e36062b3437f_xggour2.img Aug 28 08:46:30 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:31 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=17 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:46:37 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.f0bd3365-14eb-46a9-ade3-e36062b3437f_xggour2.img" returned: 0 in 7.108s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3002f866-d956-47fb-a1e9-869390c8f158]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:46:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:37 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:46:37 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Flow 'volume_create_manager' (f80808b7-9935-4720-8478-83305936d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f081aa-bfd0-4596-aafc-a2a6a4a98b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f081aa-bfd0-4596-aafc-a2a6a4a98b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-988876727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ace101-d35d-46da-8db3-701e180239d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cfcc7bffe04725946341ccb4214b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:38Z,use_quota=True,user_id='21ac5072cbe2444d9ad18ed9234bd47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ee2967-def4-4008-ac77-9e749053d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ee2967-def4-4008-ac77-9e749053d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ab873f-a9db-4fc5-bde9-894b4e6a0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ab873f-a9db-4fc5-bde9-894b4e6a0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ace101-d35d-46da-8db3-701e180239d4', 'volume_name': 'volume-45ace101-d35d-46da-8db3-701e180239d4', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cff3375-9dcc-40c4-a87b-34e97819b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cff3375-9dcc-40c4-a87b-34e97819b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dc152a-cc7e-43e9-bf5f-b2457472aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Volume 45ace101-d35d-46da-8db3-701e180239d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ace101-d35d-46da-8db3-701e180239d4', 'volume_size': 1} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:38 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 1.031s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.f0bd3365-14eb-46a9-ade3-e36062b3437f_xggour2.img {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:46:38 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Converted 1024.00 MB image at 144.04 MB/s Aug 28 08:46:38 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] f0bd3365-14eb-46a9-ade3-e36062b3437f was raw, no need to convert to raw {{(pid=85762) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:46:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:46:40 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:46:40 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:46:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-daef2277-4979-4739-97bb-55b2fa67acc9 tempest-GroupsTest-776446943 None] Group tempest-Group1-1615206702: creating Aug 28 08:46:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-daef2277-4979-4739-97bb-55b2fa67acc9 tempest-GroupsTest-776446943 None] Group tempest-Group1-1615206702: created successfully Aug 28 08:46:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-daef2277-4979-4739-97bb-55b2fa67acc9 tempest-GroupsTest-776446943 None] Create group completed successfully. Aug 28 08:46:41 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Aug 28 08:46:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.634s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:46:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:46:41 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:46:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:46:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:46:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-55069b09-80a6-4650-b01f-1229a3374809 tempest-GroupsTest-776446943 None] Group tempest-Group2-887215953: creating Aug 28 08:46:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-55069b09-80a6-4650-b01f-1229a3374809 tempest-GroupsTest-776446943 None] Group tempest-Group2-887215953: created successfully Aug 28 08:46:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-55069b09-80a6-4650-b01f-1229a3374809 tempest-GroupsTest-776446943 None] Create group completed successfully. Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (eabe8306-7d41-4ee2-a68c-20b1f84c17b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c47286-d1c8-40a5-9125-cb0b58e68234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c47286-d1c8-40a5-9125-cb0b58e68234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321286695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92522eae-ea64-432e-9c85-305ba9caccdb,host='devstack@QuobyteHD#QuobyteHD',id=d7375a26-1b0d-4be2-a2d6-c472c959e53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:44Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25b9081c-b64c-457e-976e-5fd0fc638de3),volume_type_id=25b9081c-b64c-457e-976e-5fd0fc638de3)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d71e102-cf76-4858-968d-093c1685a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d71e102-cf76-4858-968d-093c1685a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94d35f4-ed0a-4c85-9380-e0021fc83021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94d35f4-ed0a-4c85-9380-e0021fc83021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7375a26-1b0d-4be2-a2d6-c472c959e53f', 'volume_name': 'volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95ef4d5-fa52-4e6d-80dc-eb8a3da0efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95ef4d5-fa52-4e6d-80dc-eb8a3da0efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c690a-20fc-4d2b-81f1-e4bee258cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Volume d7375a26-1b0d-4be2-a2d6-c472c959e53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f', 'volume_size': 1} Aug 28 08:46:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (2764de2e-e231-4c63-acb5-650c412ff086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1154110d-2b62-47c9-841f-1d0157da8b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1154110d-2b62-47c9-841f-1d0157da8b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-703843156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3372166a-35aa-4580-9f7e-949c96d1025b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:53Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ede1972-b0dc-4a3b-a385-95114bd8cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ede1972-b0dc-4a3b-a385-95114bd8cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59f57e5-09e3-45ad-9a54-3da9dae9fa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59f57e5-09e3-45ad-9a54-3da9dae9fa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3372166a-35aa-4580-9f7e-949c96d1025b', 'volume_name': 'volume-3372166a-35aa-4580-9f7e-949c96d1025b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c58ee41-7a67-4eb3-9238-d0165b57164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c58ee41-7a67-4eb3-9238-d0165b57164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5b121-eb86-49a5-b304-4654ca0bd3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:46:53 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Volume 3372166a-35aa-4580-9f7e-949c96d1025b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3372166a-35aa-4580-9f7e-949c96d1025b', 'volume_size': 1} Aug 28 08:46:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:46:54 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=32,cinder:INSERT=4,cinder:UPDATE=25 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:47:03 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.683s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Uploaded volume to glance image-id: f0bd3365-14eb-46a9-ade3-e36062b3437f. {{(pid=85762) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.750s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-988876727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ace101-d35d-46da-8db3-701e180239d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cfcc7bffe04725946341ccb4214b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:38Z,use_quota=True,user_id='21ac5072cbe2444d9ad18ed9234bd47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Creating volume 45ace101-d35d-46da-8db3-701e180239d4 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:07 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ba57d493-203b-47db-842a-c5b8d6427168 tempest-VolumesActionsTest-1103369095 None] Copy volume to image completed successfully. Aug 28 08:47:07 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 1073741824 Aug 28 08:47:07 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:07 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 1073741824" returned: 0 in 0.625s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:07 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 Aug 28 08:47:07 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:08 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.561s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=92522eae-ea64-432e-9c85-305ba9caccdb,created_at=2026-08-28T06:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321286695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92522eae-ea64-432e-9c85-305ba9caccdb,host='devstack@QuobyteHD#QuobyteHD',id=d7375a26-1b0d-4be2-a2d6-c472c959e53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:44Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25b9081c-b64c-457e-976e-5fd0fc638de3),volume_type_id=25b9081c-b64c-457e-976e-5fd0fc638de3)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Creating volume d7375a26-1b0d-4be2-a2d6-c472c959e53f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:08 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dc152a-cc7e-43e9-bf5f-b2457472aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ace101-d35d-46da-8db3-701e180239d4', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2501dd8-cfea-4a98-860a-4bd9e6dbc9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:08 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f 1073741824 Aug 28 08:47:08 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:08 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Volume volume-45ace101-d35d-46da-8db3-701e180239d4 (45ace101-d35d-46da-8db3-701e180239d4): created successfully Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2501dd8-cfea-4a98-860a-4bd9e6dbc9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Flow 'volume_create_manager' (f80808b7-9935-4720-8478-83305936d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d68f0a25-4d36-4991-ad99-105c512e33d2 tempest-ServerActionsTestOtherA-768164863 None] Created volume successfully. Aug 28 08:47:08 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f 1073741824" returned: 0 in 0.507s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:08 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f Aug 28 08:47:08 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:08 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.494s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-703843156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3372166a-35aa-4580-9f7e-949c96d1025b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:46:53Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Creating volume 3372166a-35aa-4580-9f7e-949c96d1025b {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:08 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c690a-20fc-4d2b-81f1-e4bee258cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:08 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b 1073741824 Aug 28 08:47:08 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f23f32-2614-4c2c-910d-c13a021e64be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Volume volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f (d7375a26-1b0d-4be2-a2d6-c472c959e53f): created successfully Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f23f32-2614-4c2c-910d-c13a021e64be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (eabe8306-7d41-4ee2-a68c-20b1f84c17b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1d515bf3-2d09-4edb-a477-095b9b7a5749 tempest-GroupsTest-776446943 None] Created volume successfully. Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:09 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b 1073741824" returned: 0 in 0.513s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:09 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b Aug 28 08:47:09 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:09 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b" returned: 0 in 0.273s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.546s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5b121-eb86-49a5-b304-4654ca0bd3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3372166a-35aa-4580-9f7e-949c96d1025b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16490cd7-66ba-4bd2-a72b-84d9d0692363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6ad1de-9a88-47f5-a76d-25e3d4f0ed2c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Volume volume-3372166a-35aa-4580-9f7e-949c96d1025b (3372166a-35aa-4580-9f7e-949c96d1025b): created successfully Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16490cd7-66ba-4bd2-a72b-84d9d0692363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (2764de2e-e231-4c63-acb5-650c412ff086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-357af84f-909c-4acb-91e9-fede150f300a tempest-AttachVolumeTestJSON-217935584 None] Created volume successfully. Aug 28 08:47:09 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:47:09 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:10 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.440s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dec340-d808-478b-b2ef-3afe1d1bf745]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:10 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:47:10 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:10 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.503s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:10 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img Aug 28 08:47:10 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Acquiring lock "cinder-quobyte-d7375a26-1b0d-4be2-a2d6-c472c959e53f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-d7375a26-1b0d-4be2-a2d6-c472c959e53f" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130fa90-1ea5-4d93-9a2a-d69928bb4098]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:11 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f Aug 28 08:47:11 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:12 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f" returned: 0 in 1.113s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:12 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f Aug 28 08:47:12 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:12 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d7375a26-1b0d-4be2-a2d6-c472c959e53f" returned: 0 in 0.711s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-d7375a26-1b0d-4be2-a2d6-c472c959e53f" released by "delete_volume" :: held 1.929s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Created reservations ['9e17c1ff-196d-4079-bb5f-40d05ffebb97'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:13 devstack cinder-volume[85762]: WARNING cinder.quota [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-871918722 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-871918722, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:47:13 devstack cinder-volume[85762]: WARNING cinder.quota [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-871918722 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-871918722, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Created reservations ['931cf508-ca68-4879-b134-52d94a31349a', 'd35f69c0-7a6b-4a0c-a09a-20e576fcada4', '58b0e6c0-5f45-4b4d-81f1-150e4fe7519c', '36e73397-16af-4020-9449-bcc4e844659d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:13 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:13 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:14 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.545s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-444179f3-19be-4d58-9a5f-96cbd36091b7 req-09443d65-b95c-451e-b51f-b2315e682821 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8137837a-cc98-477e-bd62-0fe1feac566a tempest-GroupsTest-776446943 None] Delete group completed successfully. Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Created reservations ['bf686631-4631-4e6e-8ab2-3c3b60c8fae3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:14 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:14 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:16 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.188s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:16 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6b6226ef-2667-4f68-b4bd-62182da00d7c tempest-GroupsTest-776446943 None] Delete group completed successfully. Aug 28 08:47:17 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img" returned: 0 in 6.938s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:17 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823f226-e10c-4fc5-ba19-8b5fcd912d98]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:17 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:47:17 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fab13cee-097f-4701-aae5-22dbb841c7df tempest-GroupsTest-776446943 None] Group tempest-GroupsTest-Group-172122292: creating Aug 28 08:47:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fab13cee-097f-4701-aae5-22dbb841c7df tempest-GroupsTest-776446943 None] Group tempest-GroupsTest-Group-172122292: created successfully Aug 28 08:47:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fab13cee-097f-4701-aae5-22dbb841c7df tempest-GroupsTest-776446943 None] Create group completed successfully. Aug 28 08:47:18 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.550s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:47:18 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Converted 1024.00 MB image at 147.55 MB/s Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] 98f2be0c-3633-432f-bab0-4b492cc8a0c0 was raw, converting to qcow2 {{(pid=85762) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e07953-a8b4-4542-87bc-7b848fbdaa07]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:18 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img Aug 28 08:47:18 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:18 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img" returned: 0 in 0.423s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:18 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img Aug 28 08:47:18 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:19 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img" returned: 1 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:19 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9 Aug 28 08:47:19 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:19 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9" returned: 0 in 0.289s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Image conversion details: src /opt/stack/data/cinder/conversion/7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a.temp_image.98f2be0c-3633-432f-bab0-4b492cc8a0c0mat1uz_b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:47:19 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce9a57-7154-4e98-bca1-b3bbdc24da74]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:19 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9 Aug 28 08:47:19 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (5214d016-1356-4f15-967b-6611367a6b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f57c5-f80b-4453-b110-9347b2389e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:19 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62f57c5-f80b-4453-b110-9347b2389e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606012575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630339fb-df8b-45d2-865d-4b714a5f1d20,host='devstack@QuobyteHD#QuobyteHD',id=e5d54599-8d00-42bc-b49e-7ab815993bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:20Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cb1ab3-359c-4673-838e-2980c3441fd8),volume_type_id=91cb1ab3-359c-4673-838e-2980c3441fd8)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3255e-09de-4d5e-b5c3-b6221e7cf13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3255e-09de-4d5e-b5c3-b6221e7cf13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445c160f-f0fe-4db3-933c-65499ca86c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445c160f-f0fe-4db3-933c-65499ca86c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d54599-8d00-42bc-b49e-7ab815993bfc', 'volume_name': 'volume-e5d54599-8d00-42bc-b49e-7ab815993bfc', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82371486-ea6e-40bc-805a-20b44784b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82371486-ea6e-40bc-805a-20b44784b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d25f07-ecba-4c81-a796-5ab6576211cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Volume e5d54599-8d00-42bc-b49e-7ab815993bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d54599-8d00-42bc-b49e-7ab815993bfc', 'volume_size': 1} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4adv9dl9" returned: 0 in 0.450s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-052e613d-8db5-465f-9767-a3299263a5d1 req-03b81a69-9620-4795-8da0-600db1fb1d8d tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.872s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Uploaded volume to glance image-id: 98f2be0c-3633-432f-bab0-4b492cc8a0c0. {{(pid=85762) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-444179f3-19be-4d58-9a5f-96cbd36091b7 req-09443d65-b95c-451e-b51f-b2315e682821 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.499s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-444179f3-19be-4d58-9a5f-96cbd36091b7 req-09443d65-b95c-451e-b51f-b2315e682821 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=630339fb-df8b-45d2-865d-4b714a5f1d20,created_at=2026-08-28T06:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606012575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630339fb-df8b-45d2-865d-4b714a5f1d20,host='devstack@QuobyteHD#QuobyteHD',id=e5d54599-8d00-42bc-b49e-7ab815993bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:20Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cb1ab3-359c-4673-838e-2980c3441fd8),volume_type_id=91cb1ab3-359c-4673-838e-2980c3441fd8)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Creating volume e5d54599-8d00-42bc-b49e-7ab815993bfc {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:21 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6fc6a1b5-c7f6-471b-bf6d-0a25689576fd tempest-VolumesActionsTest-1103369095 None] Copy volume to image completed successfully. Aug 28 08:47:21 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc 1073741824 Aug 28 08:47:21 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-444179f3-19be-4d58-9a5f-96cbd36091b7 req-09443d65-b95c-451e-b51f-b2315e682821 tempest-AttachVolumeTestJSON-217935584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-3372166a-35aa-4580-9f7e-949c96d1025b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4288c09d-e761-458d-a56d-682a2183c1d0', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:47:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-444179f3-19be-4d58-9a5f-96cbd36091b7 req-09443d65-b95c-451e-b51f-b2315e682821 tempest-AttachVolumeTestJSON-217935584 None] attachment_update completed successfully. Aug 28 08:47:22 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc 1073741824" returned: 0 in 0.669s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:22 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc Aug 28 08:47:22 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:22 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc" returned: 0 in 0.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-052e613d-8db5-465f-9767-a3299263a5d1 req-03b81a69-9620-4795-8da0-600db1fb1d8d tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.088s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-052e613d-8db5-465f-9767-a3299263a5d1 req-03b81a69-9620-4795-8da0-600db1fb1d8d tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d25f07-ecba-4c81-a796-5ab6576211cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d54599-8d00-42bc-b49e-7ab815993bfc', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999621a5-f70b-4798-a9e1-d8c59d9111c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Volume volume-e5d54599-8d00-42bc-b49e-7ab815993bfc (e5d54599-8d00-42bc-b49e-7ab815993bfc): created successfully Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999621a5-f70b-4798-a9e1-d8c59d9111c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (5214d016-1356-4f15-967b-6611367a6b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-dc7e5a8d-46c4-4e25-be55-ff28e6c8152d tempest-GroupsTest-776446943 None] Created volume successfully. Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-052e613d-8db5-465f-9767-a3299263a5d1 req-03b81a69-9620-4795-8da0-600db1fb1d8d tempest-ServerActionsTestOtherA-768164863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-45ace101-d35d-46da-8db3-701e180239d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61be7eac-b9cd-4750-86fa-119eec4d18b9', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:47:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-052e613d-8db5-465f-9767-a3299263a5d1 req-03b81a69-9620-4795-8da0-600db1fb1d8d tempest-ServerActionsTestOtherA-768164863 None] attachment_update completed successfully. Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "cinder-quobyte-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-quobyte-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e9c18-a752-47f1-b343-72ec1dd8cfe1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:23 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:47:23 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:24 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.759s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:24 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a Aug 28 08:47:24 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (dfb193ce-9c89-4fd9-87ab-722a285a6f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b27a50a-50c7-4bd9-979c-a6d10cb5da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b27a50a-50c7-4bd9-979c-a6d10cb5da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1783407486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10075c1-4678-4be7-96fc-d78c420cb4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:24Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec86969e-e31b-45ad-ba43-4cdac16c9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec86969e-e31b-45ad-ba43-4cdac16c9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6f5de3-f120-4d1d-bff5-6ec6634e0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6f5de3-f120-4d1d-bff5-6ec6634e0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10075c1-4678-4be7-96fc-d78c420cb4bf', 'volume_name': 'volume-d10075c1-4678-4be7-96fc-d78c420cb4bf', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b194ee-4270-4230-9c3e-1a58a8ec8d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b194ee-4270-4230-9c3e-1a58a8ec8d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbb1eb3-0eb2-4b0e-92de-9359580ff1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Volume d10075c1-4678-4be7-96fc-d78c420cb4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10075c1-4678-4be7-96fc-d78c420cb4bf', 'volume_size': 1} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1783407486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10075c1-4678-4be7-96fc-d78c420cb4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97654315b5649e9a0baf9aa79fdd942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:24Z,use_quota=True,user_id='09bb875d3c4d4e139ff1a899a08905f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Creating volume d10075c1-4678-4be7-96fc-d78c420cb4bf {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:24 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:24 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf 1073741824 Aug 28 08:47:24 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (8212c2b1-c7ea-4e0f-b644-3c0efc56b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59fb004-8033-4794-9f3e-fb0918cf36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59fb004-8033-4794-9f3e-fb0918cf36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255289117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630339fb-df8b-45d2-865d-4b714a5f1d20,host='devstack@QuobyteHD#QuobyteHD',id=43a3ded0-b5a7-421d-a25b-f29308100ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:25Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cb1ab3-359c-4673-838e-2980c3441fd8),volume_type_id=91cb1ab3-359c-4673-838e-2980c3441fd8)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e25e1-a0f5-4d76-a185-bb83fc887464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e25e1-a0f5-4d76-a185-bb83fc887464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:24 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b8cc77-170b-4067-8478-720a70474787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b8cc77-170b-4067-8478-720a70474787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a3ded0-b5a7-421d-a25b-f29308100ec2', 'volume_name': 'volume-43a3ded0-b5a7-421d-a25b-f29308100ec2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d63449-998b-404e-b512-9d2ce8e9ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d63449-998b-404e-b512-9d2ce8e9ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874cc866-4bdd-4563-b521-4aa2130e0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:25 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Volume 43a3ded0-b5a7-421d-a25b-f29308100ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a3ded0-b5a7-421d-a25b-f29308100ec2', 'volume_size': 1} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" returned: 0 in 0.616s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-quobyte-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a" released by "delete_volume" :: held 1.469s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Created reservations ['2d2f90f5-4f54-4ab2-b89a-e8560416a3dd', '811294d1-7fdb-424e-ba0f-7c87dbcce761', 'fe03ddb9-8ea0-4540-8fbc-085100d093a5', '4a72a46e-6b6d-4c2c-8368-f4b21f1a63d4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:25 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:25 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:25 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Deleted volume successfully. Aug 28 08:47:25 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf 1073741824" returned: 0 in 1.003s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-80268452-9fba-4677-90f8-aad5e06c3f75 tempest-VolumesActionsTest-1103369095 None] Lock "cinder-7ebdb6a7-7cd7-4896-96a5-4b70b6380e1a-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:25 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf Aug 28 08:47:25 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:26 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=630339fb-df8b-45d2-865d-4b714a5f1d20,created_at=2026-08-28T06:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255289117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=630339fb-df8b-45d2-865d-4b714a5f1d20,host='devstack@QuobyteHD#QuobyteHD',id=43a3ded0-b5a7-421d-a25b-f29308100ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdab65e1eac34070b9fa4549055c8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:25Z,use_quota=True,user_id='f7331efb2e6d435cb50df06aae4e6708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cb1ab3-359c-4673-838e-2980c3441fd8),volume_type_id=91cb1ab3-359c-4673-838e-2980c3441fd8)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Creating volume 43a3ded0-b5a7-421d-a25b-f29308100ec2 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:26 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbb1eb3-0eb2-4b0e-92de-9359580ff1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10075c1-4678-4be7-96fc-d78c420cb4bf', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:26 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 1073741824 Aug 28 08:47:26 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db8a6c1-fc68-4475-aca2-90be09e30a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:26 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Volume volume-d10075c1-4678-4be7-96fc-d78c420cb4bf (d10075c1-4678-4be7-96fc-d78c420cb4bf): created successfully Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db8a6c1-fc68-4475-aca2-90be09e30a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Flow 'volume_create_manager' (dfb193ce-9c89-4fd9-87ab-722a285a6f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-10e02876-1afc-4fa8-bdf8-315fa374b10f tempest-AttachVolumeTestJSON-217935584 None] Created volume successfully. Aug 28 08:47:27 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 1073741824" returned: 0 in 0.984s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:27 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 Aug 28 08:47:27 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:27 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2" returned: 0 in 0.617s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874cc866-4bdd-4563-b521-4aa2130e0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a3ded0-b5a7-421d-a25b-f29308100ec2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025d5ef8-18e7-4050-9d1c-149721941b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Volume volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 (43a3ded0-b5a7-421d-a25b-f29308100ec2): created successfully Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025d5ef8-18e7-4050-9d1c-149721941b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Flow 'volume_create_manager' (8212c2b1-c7ea-4e0f-b644-3c0efc56b949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8fc7d14c-0d19-4449-8813-4dc136a3b800 tempest-GroupsTest-776446943 None] Created volume successfully. Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f7bf6900-2378-4971-9e35-aaff29a71418 req-d86ad24d-bd57-4403-8bdf-2f132ca7359e tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f7bf6900-2378-4971-9e35-aaff29a71418 req-d86ad24d-bd57-4403-8bdf-2f132ca7359e tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f7bf6900-2378-4971-9e35-aaff29a71418 req-d86ad24d-bd57-4403-8bdf-2f132ca7359e tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-ba6667a5-a60f-4dcf-ba35-8e883038420e tempest-ServerActionsTestOtherA-768164863 None] Terminate volume connection completed successfully. Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-ba6667a5-a60f-4dcf-ba35-8e883038420e tempest-ServerActionsTestOtherA-768164863 None] Deleting attachment 61be7eac-b9cd-4750-86fa-119eec4d18b9. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:47:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f7bf6900-2378-4971-9e35-aaff29a71418 req-d86ad24d-bd57-4403-8bdf-2f132ca7359e tempest-AttachVolumeTestJSON-217935584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-d10075c1-4678-4be7-96fc-d78c420cb4bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9cea52d-c034-40a0-8b15-d53c1f8fd443', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:47:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f7bf6900-2378-4971-9e35-aaff29a71418 req-d86ad24d-bd57-4403-8bdf-2f132ca7359e tempest-AttachVolumeTestJSON-217935584 None] attachment_update completed successfully. Aug 28 08:47:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f001cc42-9620-44c5-b216-4785125aedb1 tempest-GroupsTest-776446943 None] Update group completed successfully. Aug 28 08:47:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-9893ead1-3730-43a9-903a-423ca36ba05c tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-9893ead1-3730-43a9-903a-423ca36ba05c tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-9893ead1-3730-43a9-903a-423ca36ba05c tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-9893ead1-3730-43a9-903a-423ca36ba05c tempest-ServerActionsTestOtherA-768164863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-45ace101-d35d-46da-8db3-701e180239d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48957967-bafc-4c2a-9b31-6693d92d3514', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:47:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-832507bc-2a8f-425a-b729-6bcc6fe15bad req-9893ead1-3730-43a9-903a-423ca36ba05c tempest-ServerActionsTestOtherA-768164863 None] attachment_update completed successfully. Aug 28 08:47:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f52766e7-b1de-468d-817a-e646171d2f14 tempest-GroupsTest-776446943 None] Update group completed successfully. Aug 28 08:47:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-9a2d3b4d-e649-40a6-b313-9b6628c8abde req-e6f7b890-57a3-45f3-ab13-e76bb99fc6d7 tempest-AttachVolumeTestJSON-217935584 None] Terminate volume connection completed successfully. Aug 28 08:47:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-9a2d3b4d-e649-40a6-b313-9b6628c8abde req-e6f7b890-57a3-45f3-ab13-e76bb99fc6d7 tempest-AttachVolumeTestJSON-217935584 None] Deleting attachment 4288c09d-e761-458d-a56d-682a2183c1d0. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:47:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Acquiring lock "cinder-quobyte-43a3ded0-b5a7-421d-a25b-f29308100ec2" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-43a3ded0-b5a7-421d-a25b-f29308100ec2" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e539257-373e-4b1e-9451-c2a9dca9286a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-255665d9-b686-4ea9-86af-839b8d7052ee req-b8041f28-2981-4f5e-a235-aeaad3301035 tempest-AttachVolumeTestJSON-217935584 None] Terminate volume connection completed successfully. Aug 28 08:47:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-255665d9-b686-4ea9-86af-839b8d7052ee req-b8041f28-2981-4f5e-a235-aeaad3301035 tempest-AttachVolumeTestJSON-217935584 None] Deleting attachment e9cea52d-c034-40a0-8b15-d53c1f8fd443. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:47:33 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 Aug 28 08:47:33 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:34 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2" returned: 0 in 0.712s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:34 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2 Aug 28 08:47:34 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:34 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-43a3ded0-b5a7-421d-a25b-f29308100ec2" returned: 0 in 0.605s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-43a3ded0-b5a7-421d-a25b-f29308100ec2" released by "delete_volume" :: held 1.388s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Acquiring lock "cinder-quobyte-e5d54599-8d00-42bc-b49e-7ab815993bfc" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-e5d54599-8d00-42bc-b49e-7ab815993bfc" acquired by "delete_volume" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e0fac-7712-4a3a-9727-f72ad992a4fc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:35 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc Aug 28 08:47:35 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:36 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc" returned: 0 in 1.290s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:36 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc Aug 28 08:47:36 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:36 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e5d54599-8d00-42bc-b49e-7ab815993bfc" returned: 0 in 0.507s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "cinder-quobyte-e5d54599-8d00-42bc-b49e-7ab815993bfc" released by "delete_volume" :: held 1.912s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:36 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Created reservations ['63606320-ca19-487e-bf20-91dd28af8537'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:36 devstack cinder-volume[85762]: WARNING cinder.quota [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1776906468 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1776906468, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:47:36 devstack cinder-volume[85762]: WARNING cinder.quota [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1776906468 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1776906468, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Created reservations ['9c5be330-fda8-4987-82eb-2032b87684e8', 'e8bfb55c-8696-4c46-91f7-8f218c032ac9', 'd86be45d-f2c2-433d-83ae-82b2d41d807e', '664b5b47-54e5-47d3-84f6-5fbc51b6f7f9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Created reservations ['5775fc1b-4d63-496f-aef9-426d86bb63c6', '177744ac-bd7a-4e13-b5a8-7f02cd97abe9', '8ddd9b8a-f794-410b-be52-0973370cf9fc', '2eab635f-4675-48a9-979c-9a71077e4dd1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:37 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:37 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:37 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.387s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:37 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7e6d6d11-baea-4f0e-8b3d-fc1d6cfb87a7 tempest-GroupsTest-776446943 None] Delete group completed successfully. Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:40 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:40 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:40 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.612s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-d10075c1-4678-4be7-96fc-d78c420cb4bf-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-d10075c1-4678-4be7-96fc-d78c420cb4bf-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-quobyte-d10075c1-4678-4be7-96fc-d78c420cb4bf" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-d10075c1-4678-4be7-96fc-d78c420cb4bf" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c8532-9864-48fd-a5e2-75dded8cfce5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:42 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf Aug 28 08:47:42 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:42 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf" returned: 0 in 0.718s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:42 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf Aug 28 08:47:42 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:43 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d10075c1-4678-4be7-96fc-d78c420cb4bf" returned: 0 in 0.494s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-d10075c1-4678-4be7-96fc-d78c420cb4bf" released by "delete_volume" :: held 1.324s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Created reservations ['6997a05d-8902-4b9c-8a34-92060b08fedf', '483b5eef-a7aa-4d54-a845-8ef93342e155', 'cd42aa41-6411-4b0c-8cde-c8b30c849c7b', '327703e3-7d8e-47a1-815c-91f78a63d7e2'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:43 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:43 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:43 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Deleted volume successfully. Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2a57ed0c-67fa-40c0-81b9-fe0122342331 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-d10075c1-4678-4be7-96fc-d78c420cb4bf-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-3372166a-35aa-4580-9f7e-949c96d1025b-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-3372166a-35aa-4580-9f7e-949c96d1025b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-quobyte-3372166a-35aa-4580-9f7e-949c96d1025b" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-3372166a-35aa-4580-9f7e-949c96d1025b" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ee656-3f54-4658-8b01-d979e66fc939]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:44 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b Aug 28 08:47:44 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:45 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b" returned: 0 in 0.603s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:45 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b Aug 28 08:47:45 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:45 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3372166a-35aa-4580-9f7e-949c96d1025b" returned: 0 in 0.467s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-3372166a-35aa-4580-9f7e-949c96d1025b" released by "delete_volume" :: held 1.130s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Created reservations ['8b2d5952-e18b-4ffd-abd8-03d86fe94ad8', '96507b49-ffc8-4ed5-86fd-e2ea20284aad', '9a5abcca-df0b-4f67-994e-87e09381e0ba', 'ed0ecabb-eb89-47ad-9e94-dcad250aeb9b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:45 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:45 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:46 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.499s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Deleted volume successfully. Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-591b771b-835b-439e-89da-bbcf94866bc5 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-3372166a-35aa-4580-9f7e-949c96d1025b-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "cinder-quobyte-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:47:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:47:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[48879a1b-e039-44a9-9bd8-624d9be08be5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:47 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 Aug 28 08:47:47 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:47 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" returned: 0 in 0.743s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:47 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1 Aug 28 08:47:47 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:48 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-quobyte-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1" released by "delete_volume" :: held 1.240s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Created reservations ['1fc17819-526e-4bdd-b2cf-d503e29a6c9e', '37c6e107-584d-494a-8e9c-85b4bab522eb', 'fd0c4bf4-202c-49da-ac1e-791358a671fb', '270c7daf-c093-4cf3-ad30-9419b1a606e1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:48 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:47:48 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:48 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:47:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Deleted volume successfully. Aug 28 08:47:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5455f521-f17f-4f65-be81-ef8cf4a0fc01 tempest-AttachVolumeTestJSON-217935584 None] Lock "cinder-d38f155c-d31e-42d9-a5e7-cb6269bdb7f1-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (de6945a7-fe64-49fe-acd4-2c29b1a775fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c668003d-b969-43d0-b93c-18cee305fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c668003d-b969-43d0-b93c-18cee305fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335380660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c628634c-1d1f-4035-a065-27eed110d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:55Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4c698-20d5-41cf-ad79-21ed6e8b6f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c4c698-20d5-41cf-ad79-21ed6e8b6f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ecfbe-c649-4d81-a9cd-841875c03231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ecfbe-c649-4d81-a9cd-841875c03231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c628634c-1d1f-4035-a065-27eed110d00a', 'volume_name': 'volume-c628634c-1d1f-4035-a065-27eed110d00a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4414108d-3d84-4d32-b886-b2c1dfb9f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4414108d-3d84-4d32-b886-b2c1dfb9f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58f1d06-f3c2-4e91-a491-3755bb927fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Volume c628634c-1d1f-4035-a065-27eed110d00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c628634c-1d1f-4035-a065-27eed110d00a', 'volume_size': 1} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335380660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c628634c-1d1f-4035-a065-27eed110d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:47:55Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Creating volume c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:47:55 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:47:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:55 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a 1073741824 Aug 28 08:47:55 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:56 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a 1073741824" returned: 0 in 0.727s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:56 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a Aug 28 08:47:56 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:56 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58f1d06-f3c2-4e91-a491-3755bb927fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c628634c-1d1f-4035-a065-27eed110d00a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d3e4a3-7cea-4d61-923c-ae96019dedc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:47:56 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Volume volume-c628634c-1d1f-4035-a065-27eed110d00a (c628634c-1d1f-4035-a065-27eed110d00a): created successfully Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d3e4a3-7cea-4d61-923c-ae96019dedc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:47:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (de6945a7-fe64-49fe-acd4-2c29b1a775fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:47:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-087b0011-301a-402e-a121-bfc2aef8d138 tempest-VolumesSnapshotTestJSON-943788347 None] Created volume successfully. Aug 28 08:47:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:47:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:47:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Creating offline snapshot d20c654a-d01b-485a-98d0-36e2a29af031 of volume c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:47:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08060d-2269-4bab-8f78-3a02c2deb47a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:47:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:58 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a Aug 28 08:47:58 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:58 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a" returned: 0 in 0.798s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:58 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 1G Aug 28 08:47:58 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:47:59 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Aug 28 08:47:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 1G" returned: 0 in 0.847s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:47:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c628634c-1d1f-4035-a065-27eed110d00a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:47:59 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c628634c-1d1f-4035-a065-27eed110d00a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 Aug 28 08:47:59 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:00 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c628634c-1d1f-4035-a065-27eed110d00a -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031" returned: 0 in 0.585s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:00 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 is being set with open permissions: ugo+rw Aug 28 08:48:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:00 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 Aug 28 08:48:00 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:00 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031" returned: 0 in 0.415s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:00 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info Aug 28 08:48:00 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:01 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info" returned: 0 in 0.505s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:01 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info is being set with open permissions: ugo+rw Aug 28 08:48:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:01 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info Aug 28 08:48:01 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:01 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.info" returned: 0 in 0.336s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.708s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0cf8dc4f-de44-4a49-8443-b9ba92b41fed tempest-VolumesSnapshotTestJSON-943788347 None] Create snapshot completed successfully Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-d20c654a-d01b-485a-98d0-36e2a29af031-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-d20c654a-d01b-485a-98d0-36e2a29af031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-d20c654a-d01b-485a-98d0-36e2a29af031" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-d20c654a-d01b-485a-98d0-36e2a29af031" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Deleting offline snapshot d20c654a-d01b-485a-98d0-36e2a29af031 of volume c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] snapshot_file for this snap is: volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[42686006-d78f-46a2-b817-1efbe7ca2691]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:02 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 Aug 28 08:48:02 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:03 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031" returned: 0 in 0.519s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c628634c-1d1f-4035-a065-27eed110d00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c830e-0a2a-4533-a692-7f85209b7eb9]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:03 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a Aug 28 08:48:03 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:03 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a" returned: 0 in 0.456s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:03 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 Aug 28 08:48:03 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:04 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031" returned: 0 in 0.459s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:04 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031 Aug 28 08:48:04 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:04 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a.d20c654a-d01b-485a-98d0-36e2a29af031" returned: 0 in 0.359s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=112,cinder:INSERT=21,cinder:UPDATE=97,cinder:DELETE=4 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=93,cinder:SELECT=98,cinder:DELETE=8,cinder:INSERT=18 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-d20c654a-d01b-485a-98d0-36e2a29af031" released by "_delete_snapshot" :: held 1.969s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" released by "delete_snapshot" :: held 2.026s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['ab5b4f06-8d8e-4718-9017-dbcf9a0f8469', 'a52034f6-8dc8-43ff-ac7f-183ed54d79f3', '68f58838-b3c8-4cd5-aaf7-43a5bff30356', 'f9f9423b-7892-4772-ac9d-893dc4dcc55c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Delete snapshot completed successfully. Aug 28 08:48:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-362d5b9c-d631-4ed5-b6a5-6dc0191103d8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-d20c654a-d01b-485a-98d0-36e2a29af031-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Flow 'volume_create_manager' (d96a41b8-180b-42e9-a082-9aa1a2ff6303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d007cc-28fd-4b0b-b0c2-6b5365278bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d007cc-28fd-4b0b-b0c2-6b5365278bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-106420944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67c46d0-da39-4319-bccf-5f16f092f8ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c78552a28134e21aa3b50e13452b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:06Z,use_quota=True,user_id='ad9644ff85984544bd7b91c8acd5fae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701c654-6e0f-4750-8d81-544642e7df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8701c654-6e0f-4750-8d81-544642e7df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36733eae-a2e6-4fba-aa32-b499bee8a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36733eae-a2e6-4fba-aa32-b499bee8a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67c46d0-da39-4319-bccf-5f16f092f8ff', 'volume_name': 'volume-a67c46d0-da39-4319-bccf-5f16f092f8ff', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd6790f-5dcc-4f3c-827b-37e8699ab0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd6790f-5dcc-4f3c-827b-37e8699ab0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9928c8-c31f-4871-a354-a1c73416c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Volume a67c46d0-da39-4319-bccf-5f16f092f8ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67c46d0-da39-4319-bccf-5f16f092f8ff', 'volume_size': 1} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-106420944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67c46d0-da39-4319-bccf-5f16f092f8ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c78552a28134e21aa3b50e13452b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:06Z,use_quota=True,user_id='ad9644ff85984544bd7b91c8acd5fae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Creating volume a67c46d0-da39-4319-bccf-5f16f092f8ff {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:05 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff 1073741824 Aug 28 08:48:05 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:06 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff 1073741824" returned: 0 in 0.656s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:06 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff Aug 28 08:48:06 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (de0e1060-cb21-474c-9a53-24acd8e4e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8c5225-69ee-4ff3-a032-b0374fd866a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8c5225-69ee-4ff3-a032-b0374fd866a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364217905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fb5eec-f704-47b7-9751-e4b1349c70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:07Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08529819-b2b6-4a0f-8039-6023c7ac6c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08529819-b2b6-4a0f-8039-6023c7ac6c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ef5dbb-890d-4ea0-9afd-2ead7cb5115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ef5dbb-890d-4ea0-9afd-2ead7cb5115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4fb5eec-f704-47b7-9751-e4b1349c70d3', 'volume_name': 'volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667534c-cf0a-4059-8c52-15e9ba5e7c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667534c-cf0a-4059-8c52-15e9ba5e7c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7543e5b-1aaa-415d-bd1f-6d189fc880df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Volume f4fb5eec-f704-47b7-9751-e4b1349c70d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3', 'volume_size': 1} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff" returned: 0 in 0.435s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364217905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fb5eec-f704-47b7-9751-e4b1349c70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:07Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Creating volume f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:06 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:06 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 1073741824 Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9928c8-c31f-4871-a354-a1c73416c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67c46d0-da39-4319-bccf-5f16f092f8ff', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb53b64c-fde7-4fc1-8877-e2f89921577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Volume volume-a67c46d0-da39-4319-bccf-5f16f092f8ff (a67c46d0-da39-4319-bccf-5f16f092f8ff): created successfully Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb53b64c-fde7-4fc1-8877-e2f89921577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Flow 'volume_create_manager' (d96a41b8-180b-42e9-a082-9aa1a2ff6303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-3999150b-1cc9-4501-a27e-d19ae7933d25 req-937b5ade-f9bc-49e7-bda6-33a89cbfcdb3 tempest-VolumesGetTestJSON-1735068214 None] Created volume successfully. Aug 28 08:48:07 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 1073741824" returned: 0 in 0.582s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:07 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:07 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:07 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.279s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7543e5b-1aaa-415d-bd1f-6d189fc880df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4f26a0-f4f4-424e-a01f-fc1e163ad96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:07 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Volume volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 (f4fb5eec-f704-47b7-9751-e4b1349c70d3): created successfully Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4f26a0-f4f4-424e-a01f-fc1e163ad96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (de0e1060-cb21-474c-9a53-24acd8e4e818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-980b7b2e-2cad-4270-8eba-8da62c504c59 tempest-VolumesSnapshotTestJSON-943788347 None] Created volume successfully. Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Acquiring lock "cinder-a67c46d0-da39-4319-bccf-5f16f092f8ff-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "cinder-a67c46d0-da39-4319-bccf-5f16f092f8ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Acquiring lock "cinder-quobyte-a67c46d0-da39-4319-bccf-5f16f092f8ff" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "cinder-quobyte-a67c46d0-da39-4319-bccf-5f16f092f8ff" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa6989-d22d-4b2c-ac2c-35a33be98a30]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:08 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff Aug 28 08:48:08 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:09 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff" returned: 0 in 0.523s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:09 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff Aug 28 08:48:09 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Creating offline snapshot e106c679-828a-4ef6-aae8-43d01df04b51 of volume f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a1ea79-401c-4114-9ab6-ff121c23350e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:09 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:09 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:09 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a67c46d0-da39-4319-bccf-5f16f092f8ff" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "cinder-quobyte-a67c46d0-da39-4319-bccf-5f16f092f8ff" released by "delete_volume" :: held 0.957s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG cinder.quota [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Created reservations ['aadcc7fa-b623-4194-8744-4d81df5255c3', 'bf7e9373-d688-41a6-a0ba-410d0c50e6a0', 'f213fb31-a842-48a7-bb53-33b739de1f37', '7c631f9d-a5f9-4c57-abde-cb58076d9a02'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:09 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:09 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:09 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.579s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:09 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 1G Aug 28 08:48:09 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:10 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.379s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG cinder.manager [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Deleted volume successfully. Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-9108a852-78aa-448b-8304-9d1b4eacf91b req-5b8e9e47-c2f0-49de-88e3-05f48e102999 tempest-VolumesGetTestJSON-1735068214 None] Lock "cinder-a67c46d0-da39-4319-bccf-5f16f092f8ff-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:10 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 1G" returned: 0 in 0.694s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:10 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:10 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:10 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.465s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:10 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 is being set with open permissions: ugo+rw Aug 28 08:48:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:10 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:10 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:11 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.360s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:11 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info Aug 28 08:48:11 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:11 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info" returned: 0 in 0.342s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:11 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info is being set with open permissions: ugo+rw Aug 28 08:48:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:11 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info Aug 28 08:48:11 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:12 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.info" returned: 0 in 0.379s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-02b28d88-bcf3-457e-9e5b-2e772d2f013b tempest-VolumesSnapshotTestJSON-943788347 None] Create snapshot completed successfully Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Flow 'volume_create_manager' (ff6945a5-73b2-43ea-9a5d-34cce701c649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344e6d2a-ce5b-46fa-8750-23bf9429bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344e6d2a-ce5b-46fa-8750-23bf9429bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161793612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02557113-21cd-430f-80d6-2b7dacbf704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04305264da2e476f8f3a612ff8f36b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:13Z,use_quota=True,user_id='1b7a85016ca84e90a8540858f329235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4111546d-af57-493f-839e-8a779ff0d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4111546d-af57-493f-839e-8a779ff0d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63cc03-0a99-470e-a4c2-53f99edf8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63cc03-0a99-470e-a4c2-53f99edf8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02557113-21cd-430f-80d6-2b7dacbf704a', 'volume_name': 'volume-02557113-21cd-430f-80d6-2b7dacbf704a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9999d1-3cdf-4a67-8637-4bd68250c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9999d1-3cdf-4a67-8637-4bd68250c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8d389e-e5d8-4294-b534-6c88226a7277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:12 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume 02557113-21cd-430f-80d6-2b7dacbf704a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02557113-21cd-430f-80d6-2b7dacbf704a', 'volume_size': 1} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161793612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02557113-21cd-430f-80d6-2b7dacbf704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04305264da2e476f8f3a612ff8f36b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:13Z,use_quota=True,user_id='1b7a85016ca84e90a8540858f329235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Creating volume 02557113-21cd-430f-80d6-2b7dacbf704a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:13 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:13 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a 1073741824 Aug 28 08:48:13 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (602b4766-ddce-42a4-994b-c8d321166c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b8635e-96c5-45e6-8b7a-cf6003cb6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b8635e-96c5-45e6-8b7a-cf6003cb6e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1720717500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8252164e-be6f-48e9-865c-43e75760fc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e106c679-828a-4ef6-aae8-43d01df04b51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:13Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e53d9d-5824-46c0-ad8d-aac4fac48bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e53d9d-5824-46c0-ad8d-aac4fac48bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681eb460-00fe-4b59-9421-6957a3de0345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681eb460-00fe-4b59-9421-6957a3de0345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8252164e-be6f-48e9-865c-43e75760fc74', 'volume_name': 'volume-8252164e-be6f-48e9-865c-43e75760fc74', 'volume_size': 2, 'snapshot_id': 'e106c679-828a-4ef6-aae8-43d01df04b51'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5c2d1e-d848-447a-870f-20dd2e6b7cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5c2d1e-d848-447a-870f-20dd2e6b7cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c533ca3f-9373-4933-ba85-d9e68fa57ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:13 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Volume 8252164e-be6f-48e9-865c-43e75760fc74: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8252164e-be6f-48e9-865c-43e75760fc74', 'volume_size': 2, 'snapshot_id': 'e106c679-828a-4ef6-aae8-43d01df04b51'} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:13 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-654b5694-efcb-462a-8d63-79503e9926ff req-cbe4e127-25f9-4036-929e-ecbb742becf5 tempest-ServerActionsTestOtherA-768164863 None] Terminate volume connection completed successfully. Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-654b5694-efcb-462a-8d63-79503e9926ff req-cbe4e127-25f9-4036-929e-ecbb742becf5 tempest-ServerActionsTestOtherA-768164863 None] Deleting attachment 48957967-bafc-4c2a-9b31-6693d92d3514. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a 1073741824" returned: 0 in 0.666s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:13 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a Aug 28 08:48:13 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:14 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a" returned: 0 in 0.376s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.591s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51-8252164e-be6f-48e9-865c-43e75760fc74" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8d389e-e5d8-4294-b534-6c88226a7277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02557113-21cd-430f-80d6-2b7dacbf704a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ef12bc-8a7b-4dfd-a11e-c382159ac118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51-8252164e-be6f-48e9-865c-43e75760fc74" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Creating volume 8252164e-be6f-48e9-865c-43e75760fc74 from snapshot e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume volume-02557113-21cd-430f-80d6-2b7dacbf704a (02557113-21cd-430f-80d6-2b7dacbf704a): created successfully Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ef12bc-8a7b-4dfd-a11e-c382159ac118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Flow 'volume_create_manager' (ff6945a5-73b2-43ea-9a5d-34cce701c649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] snapshot: e106c679-828a-4ef6-aae8-43d01df04b51, volume: 8252164e-be6f-48e9-865c-43e75760fc74, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:48:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-76b9101c-6c1a-4eb5-804a-07ac4ba81bff tempest-VolumeQuotasAdminTestJSON-46476090 None] Created volume successfully. Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[392de40e-d5db-455a-9319-956784e0210a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:14 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:14 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:14 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.497s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[02362574-1537-4c60-9274-29cd40ed9daf]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:14 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:14 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "cinder-02557113-21cd-430f-80d6-2b7dacbf704a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "cinder-02557113-21cd-430f-80d6-2b7dacbf704a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "cinder-quobyte-02557113-21cd-430f-80d6-2b7dacbf704a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "cinder-quobyte-02557113-21cd-430f-80d6-2b7dacbf704a" acquired by "delete_volume" :: waited 0.044s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d57c5-04b3-4b71-b93b-f37c0224372e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:15 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.666s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:15 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a Aug 28 08:48:15 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:15 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 Aug 28 08:48:15 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:15 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a" returned: 0 in 0.511s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:15 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a Aug 28 08:48:15 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:16 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02557113-21cd-430f-80d6-2b7dacbf704a" returned: 0 in 0.606s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "cinder-quobyte-02557113-21cd-430f-80d6-2b7dacbf704a" released by "delete_volume" :: held 1.236s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Created reservations ['85756951-a275-41ae-ae3c-d382aa20807d', '6e5c3769-c4ba-44a5-962f-e95d687a75d7', '9c2f988d-4cac-4a2d-a04a-36ca0f1c6a0a', 'a93b9f24-cbda-4b67-b542-5c1fa33c3429'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:17 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:17 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:17 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.707s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Deleted volume successfully. Aug 28 08:48:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2866d452-1483-4147-96aa-e548c3615758 tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "cinder-02557113-21cd-430f-80d6-2b7dacbf704a-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Flow 'volume_create_manager' (6c685753-5e66-442b-bfca-1208f75393ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6972e-0b52-4c24-a94a-ca38f3737c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6972e-0b52-4c24-a94a-ca38f3737c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1313906886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04305264da2e476f8f3a612ff8f36b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:20Z,use_quota=True,user_id='1b7a85016ca84e90a8540858f329235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697378ce-5872-4d8e-883c-24bbbf36129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697378ce-5872-4d8e-883c-24bbbf36129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf4a06a-4dbb-4d2c-b34d-0494829516cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf4a06a-4dbb-4d2c-b34d-0494829516cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d', 'volume_name': 'volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5d22da-4e24-40e9-b105-ac96a77804c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5d22da-4e24-40e9-b105-ac96a77804c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8e7699-a131-4a3a-97f9-62da42268281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume 4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d', 'volume_size': 1} Aug 28 08:48:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:21 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74" returned: 0 in 6.338s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:21 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:48:21 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Converted 1024.00 MB image at 161.53 MB/s Aug 28 08:48:21 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 is being set with open permissions: ugo+rw Aug 28 08:48:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:21 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 Aug 28 08:48:21 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:22 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" released by "_copy_volume_from_snapshot" :: held 7.977s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51-8252164e-be6f-48e9-865c-43e75760fc74" released by "_create_volume_from_snapshot" :: held 8.069s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.105s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.869s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1313906886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04305264da2e476f8f3a612ff8f36b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:20Z,use_quota=True,user_id='1b7a85016ca84e90a8540858f329235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Creating volume 4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:22 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:22 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d 1073741824 Aug 28 08:48:22 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c533ca3f-9373-4933-ba85-d9e68fa57ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8252164e-be6f-48e9-865c-43e75760fc74', 'volume_size': 2, 'snapshot_id': 'e106c679-828a-4ef6-aae8-43d01df04b51'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0bacd-1a73-4660-8bb5-06af512f67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Volume volume-8252164e-be6f-48e9-865c-43e75760fc74 (8252164e-be6f-48e9-865c-43e75760fc74): created successfully Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f0bacd-1a73-4660-8bb5-06af512f67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (602b4766-ddce-42a4-994b-c8d321166c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d7972e90-9316-48e5-b909-12f32151610a tempest-VolumesSnapshotTestJSON-943788347 None] Created volume successfully. Aug 28 08:48:22 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d 1073741824" returned: 0 in 0.617s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:22 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d Aug 28 08:48:22 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-8252164e-be6f-48e9-865c-43e75760fc74-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-8252164e-be6f-48e9-865c-43e75760fc74-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b35d9-0524-46af-9b84-50ecf0235b0f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:23 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" returned: 0 in 0.365s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8e7699-a131-4a3a-97f9-62da42268281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca9c6fb-4335-442e-a30b-da766e6675fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:23 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 Aug 28 08:48:23 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Volume volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d (4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d): created successfully Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca9c6fb-4335-442e-a30b-da766e6675fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Flow 'volume_create_manager' (6c685753-5e66-442b-bfca-1208f75393ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-10f9ef24-8de5-4c95-bd38-f5192c93711b tempest-VolumeQuotasAdminTestJSON-46476090 None] Created volume successfully. Aug 28 08:48:23 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:23 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74 Aug 28 08:48:23 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:23 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8252164e-be6f-48e9-865c-43e75760fc74" returned: 0 in 0.289s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-8252164e-be6f-48e9-865c-43e75760fc74" released by "delete_volume" :: held 0.753s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:23 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['82d9c61e-cc6d-48e4-99bd-433b7b308f51', '4ee32c34-e947-45f2-84e7-c1e368b18f54', 'e3d61ac4-1340-4533-91df-37d1a7d2c9ce', 'e9db4940-8faa-4690-99af-04b6e83bec8d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:24 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:24 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Flow 'volume_create_manager' (a22e0394-20ea-40b3-86c3-1da8fe1e55d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f5ad0-322c-4e89-b50f-03915dfcfefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f5ad0-322c-4e89-b50f-03915dfcfefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-86957529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae66753-e6f3-4369-b150-6f445b46a1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cfcc7bffe04725946341ccb4214b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:24Z,use_quota=True,user_id='21ac5072cbe2444d9ad18ed9234bd47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e258ec-d3b4-47d7-860c-eba15803b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e258ec-d3b4-47d7-860c-eba15803b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686ce399-4ee4-4560-b939-00a3cd3881f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-e106c679-828a-4ef6-aae8-43d01df04b51-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-e106c679-828a-4ef6-aae8-43d01df04b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:24 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Deleting offline snapshot e106c679-828a-4ef6-aae8-43d01df04b51 of volume f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] snapshot_file for this snap is: volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.392s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Deleted volume successfully. Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03a1d8-eb40-4be3-b785-3d093b3bf82c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc8e2cae-1d8d-4af2-bc16-6cf5752c9a1a tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-8252164e-be6f-48e9-865c-43e75760fc74-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:24 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:24 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686ce399-4ee4-4560-b939-00a3cd3881f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ae66753-e6f3-4369-b150-6f445b46a1bc', 'volume_name': 'volume-5ae66753-e6f3-4369-b150-6f445b46a1bc', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906fab42-0b59-4691-bc98-e7f18f72d167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906fab42-0b59-4691-bc98-e7f18f72d167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d3d14e-76be-4810-8281-3866fe7e3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:24 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Volume 5ae66753-e6f3-4369-b150-6f445b46a1bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ae66753-e6f3-4369-b150-6f445b46a1bc', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Trying to clone 5ae66753-e6f3-4369-b150-6f445b46a1bc from image f08659ba-d34f-40d3-9342-92af7297d5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 08:48:24 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.475s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[60482c99-50c9-4cd9-b0bf-b450d1d0bb4c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:25 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:25 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-547d2649-8094-4207-9dce-137f7df116e7 tempest-VolumeQuotasAdminTestJSON-17121322 None] Transfer volume completed successfully. Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 08:48:25 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Image download 20.69 MB at 20.69 MB/s Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c18ed-c236-4ab6-9b1a-eb4b08eacd18]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:25 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD Aug 28 08:48:25 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:25 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.934s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:26 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD" returned: 0 in 0.561s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 is fetched for user 21ac5072cbe2444d9ad18ed9234bd47f. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df6fb9-17cf-40d8-9c60-c81d3c276042]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Acquiring lock "cinder-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "cinder-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Acquiring lock "cinder-quobyte-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "cinder-quobyte-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbf30e-b3c0-4264-b3f5-367c0be5f4f3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD Aug 28 08:48:26 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.455s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:26 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51 Aug 28 08:48:26 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-86957529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae66753-e6f3-4369-b150-6f445b46a1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21cfcc7bffe04725946341ccb4214b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:24Z,use_quota=True,user_id='21ac5072cbe2444d9ad18ed9234bd47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Creating volume 5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:26 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1073741824 Aug 28 08:48:26 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3.e106c679-828a-4ef6-aae8-43d01df04b51" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:26 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" returned: 0 in 0.437s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-e106c679-828a-4ef6-aae8-43d01df04b51" released by "_delete_snapshot" :: held 2.319s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" released by "delete_snapshot" :: held 2.352s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:26 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d Aug 28 08:48:26 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['62a1bf01-cc03-49ea-89a6-3a3174a953b1', '543fac4a-4701-40ba-9676-dc129aa151e5', '877c50fd-93b1-4c45-9b39-9bed8f085ec0', 'a040ef51-70ae-4293-958c-7f3687d27567'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Delete snapshot completed successfully. Aug 28 08:48:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fbdad6d1-08f7-40ed-830d-276adee7b286 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-e106c679-828a-4ef6-aae8-43d01df04b51-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:27 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" returned: 0 in 0.345s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "cinder-quobyte-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d" released by "delete_volume" :: held 0.828s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:27 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1073741824" returned: 0 in 0.537s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Created reservations ['45179f95-ac1f-4a35-a141-3b9bdd740823', '2e803ebc-b0b6-4951-919f-0c442a105717', '124de139-9bd5-47be-aa3f-e4407c1b4647', '408c9d59-7b4b-428c-9a71-061b82935076'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:27 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc Aug 28 08:48:27 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:27 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:27 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:27 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc" returned: 0 in 0.343s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Attempting download of f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 5ae66753-e6f3-4369-b150-6f445b46a1bc. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ab1b3-a0fb-482c-bef0-afdf86dc5e8e]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:27 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-f4fb5eec-f704-47b7-9751-e4b1349c70d3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Deleted volume successfully. Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-f4fb5eec-f704-47b7-9751-e4b1349c70d3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-34df2268-dc4f-4a5c-a7b5-a270b78901c7 tempest-VolumeQuotasAdminTestJSON-240936577 None] Lock "cinder-4f7854dc-ab7e-4ecc-8ec4-f09f02c70d6d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:27 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8 Aug 28 08:48:27 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be430ce-a425-462e-9f41-a2607aebea3e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:28 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:28 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:28 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8" returned: 0 in 0.428s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:28 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8 Aug 28 08:48:28 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:28 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:28 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3 Aug 28 08:48:28 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:28 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8" returned: 1 in 0.510s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_jijjl6y8' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b4f154-6e73-4dd1-b369-312e6b31072f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:28 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD Aug 28 08:48:28 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:28 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f4fb5eec-f704-47b7-9751-e4b1349c70d3" returned: 0 in 0.352s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f4fb5eec-f704-47b7-9751-e4b1349c70d3" released by "delete_volume" :: held 1.011s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:28 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['7e37e991-f318-45c4-843b-c79e2ff5f4ea', '65ddce79-eaaf-480f-9dc7-3f8edb7e3ebd', '819cee9a-a25c-4170-b70c-ed0a7b3a8135', 'ff10d521-d08a-459c-adaa-666514666d4e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:29 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] f08659ba-d34f-40d3-9342-92af7297d5d7 was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:29 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:29 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:29 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc Aug 28 08:48:29 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:29 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.364s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Deleted volume successfully. Aug 28 08:48:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6778b5a8-f839-4eb0-b0b5-c433a712899d tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-f4fb5eec-f704-47b7-9751-e4b1349c70d3-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (f5edbaae-c835-4b56-a720-d1c9746ce451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f9b47b-ac84-4dd5-a6e9-273ebcdcbcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f9b47b-ac84-4dd5-a6e9-273ebcdcbcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1018300122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a761db2b-12d5-4bbc-817c-957d6ec04c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:31Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6573094-ccde-46f8-b4a2-6bd10c77a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6573094-ccde-46f8-b4a2-6bd10c77a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437c3f6d-9264-4f06-ad53-0a8b0793f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437c3f6d-9264-4f06-ad53-0a8b0793f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a761db2b-12d5-4bbc-817c-957d6ec04c49', 'volume_name': 'volume-a761db2b-12d5-4bbc-817c-957d6ec04c49', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada3d6d7-2ad1-4004-a815-75d7514d33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada3d6d7-2ad1-4004-a815-75d7514d33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f872d370-1188-465d-8916-6146f513f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:31 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Volume a761db2b-12d5-4bbc-817c-957d6ec04c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a761db2b-12d5-4bbc-817c-957d6ec04c49', 'volume_size': 1} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1018300122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a761db2b-12d5-4bbc-817c-957d6ec04c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:31Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Creating volume a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:31 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:31 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 1073741824 Aug 28 08:48:31 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:31 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc" returned: 0 in 2.803s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_29jw24d4devstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:48:31 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Converted 112.00 MB image at 39.94 MB/s Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:31 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 1073741824" returned: 0 in 0.725s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:31 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1G Aug 28 08:48:31 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:32 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:32 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:32 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 0.345s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f872d370-1188-465d-8916-6146f513f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a761db2b-12d5-4bbc-817c-957d6ec04c49', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:32 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf610526-c31c-4b09-8273-be65762ae0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc 1G" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Downloaded image f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 5ae66753-e6f3-4369-b150-6f445b46a1bc successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 for user 21ac5072cbe2444d9ad18ed9234bd47f is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Marking volume 5ae66753-e6f3-4369-b150-6f445b46a1bc as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 08:48:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Volume volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 (a761db2b-12d5-4bbc-817c-957d6ec04c49): created successfully Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf610526-c31c-4b09-8273-be65762ae0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (f5edbaae-c835-4b56-a720-d1c9746ce451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Copying metadata from image f08659ba-d34f-40d3-9342-92af7297d5d7 to 5ae66753-e6f3-4369-b150-6f445b46a1bc. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Creating volume glance metadata for volume 5ae66753-e6f3-4369-b150-6f445b46a1bc backed by image f08659ba-d34f-40d3-9342-92af7297d5d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 08:48:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b0cd05d7-aa46-4ce6-a2b4-2329ad5b4de5 tempest-VolumesSnapshotTestJSON-943788347 None] Created volume successfully. Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d3d14e-76be-4810-8281-3866fe7e3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae66753-e6f3-4369-b150-6f445b46a1bc', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515a3fa1-9b80-4bea-870b-c8090ee393a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Volume volume-5ae66753-e6f3-4369-b150-6f445b46a1bc (5ae66753-e6f3-4369-b150-6f445b46a1bc): created successfully Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515a3fa1-9b80-4bea-870b-c8090ee393a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Flow 'volume_create_manager' (a22e0394-20ea-40b3-86c3-1da8fe1e55d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2b089713-4ab1-4cb4-970e-e46f4e9fcc15 tempest-ServerActionsTestOtherA-768164863 None] Created volume successfully. Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Creating offline snapshot f76a6381-37fd-4fb6-8748-f57f99145ff4 of volume a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed8c46c-d8df-45d3-a35d-8b79b9797d93]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:33 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:33 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:33 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 0.543s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:34 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 1G Aug 28 08:48:34 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:34 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 1G" returned: 0 in 0.645s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:34 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:34 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:35 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 0.536s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:35 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 is being set with open permissions: ugo+rw Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:35 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:35 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:35 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:35 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info Aug 28 08:48:35 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:35 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info" returned: 0 in 0.330s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:35 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info is being set with open permissions: ugo+rw Aug 28 08:48:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:36 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info Aug 28 08:48:36 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:36 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.info" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4416558e-3380-492b-9288-759bde83aec8 tempest-VolumesSnapshotTestJSON-943788347 None] Create snapshot completed successfully Aug 28 08:48:37 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (f81afee1-fd78-421c-adbc-b0e6ca2f9fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c85ea-613d-4823-98e5-7011952df006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f1f7b350-ea47-44c4-b5f7-0548011b8e90 req-f3bb108d-bb50-43dc-86d9-037b86dbc35b tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f1f7b350-ea47-44c4-b5f7-0548011b8e90 req-f3bb108d-bb50-43dc-86d9-037b86dbc35b tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c85ea-613d-4823-98e5-7011952df006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1414716645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81b5022-d648-4bf2-8c73-f5f5e27b938d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='510cf0ec4edd426a894fb347a789253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f76a6381-37fd-4fb6-8748-f57f99145ff4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:38Z,use_quota=True,user_id='68be0230347f49f5850e5e117b7737d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814766d0-2afd-480c-9b0d-374660bcbcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814766d0-2afd-480c-9b0d-374660bcbcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c771e2f-feb7-4839-a003-c74138464b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c771e2f-feb7-4839-a003-c74138464b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c81b5022-d648-4bf2-8c73-f5f5e27b938d', 'volume_name': 'volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d', 'volume_size': 1, 'snapshot_id': 'f76a6381-37fd-4fb6-8748-f57f99145ff4'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2414477-003c-46d0-8c61-f4b8f13b33fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2414477-003c-46d0-8c61-f4b8f13b33fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d5775-44e9-40f1-be45-391991b3a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Volume c81b5022-d648-4bf2-8c73-f5f5e27b938d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d', 'volume_size': 1, 'snapshot_id': 'f76a6381-37fd-4fb6-8748-f57f99145ff4'} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f1f7b350-ea47-44c4-b5f7-0548011b8e90 req-f3bb108d-bb50-43dc-86d9-037b86dbc35b tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4-c81b5022-d648-4bf2-8c73-f5f5e27b938d" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4-c81b5022-d648-4bf2-8c73-f5f5e27b938d" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Creating volume c81b5022-d648-4bf2-8c73-f5f5e27b938d from snapshot f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Flow 'volume_create_manager' (28c3c7ca-7acc-4bad-b1ff-a0e8d4cc8a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edaf20c-6893-44b7-950b-d47d2bbfa025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f1f7b350-ea47-44c4-b5f7-0548011b8e90 req-f3bb108d-bb50-43dc-86d9-037b86dbc35b tempest-ServerActionsTestOtherA-768164863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-5ae66753-e6f3-4369-b150-6f445b46a1bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c605568-b5be-47de-836a-cc8d0ca3b156', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] snapshot: f76a6381-37fd-4fb6-8748-f57f99145ff4, volume: c81b5022-d648-4bf2-8c73-f5f5e27b938d, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edaf20c-6893-44b7-950b-d47d2bbfa025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-214347065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c07d4c-8227-4b5e-8f2f-4442c5e1ef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7440c071a97a48009cf92feba9820db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:38Z,use_quota=True,user_id='43c285adb7a94a25b82200210a1a05ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5ed9f-4a03-4b34-baab-46c1defe7104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5ed9f-4a03-4b34-baab-46c1defe7104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e50d95c-29ce-4787-ae59-c83a5386078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[042cee25-af6f-4109-a99b-44158fbe7676]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f1f7b350-ea47-44c4-b5f7-0548011b8e90 req-f3bb108d-bb50-43dc-86d9-037b86dbc35b tempest-ServerActionsTestOtherA-768164863 None] attachment_update completed successfully. Aug 28 08:48:38 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:38 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e50d95c-29ce-4787-ae59-c83a5386078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94c07d4c-8227-4b5e-8f2f-4442c5e1ef03', 'volume_name': 'volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9516c31a-0d90-4113-996d-db87d01b6c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9516c31a-0d90-4113-996d-db87d01b6c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb976ca-6e83-4726-8c81-d919b2c8ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 08:48:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Trying to clone 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 from image f08659ba-d34f-40d3-9342-92af7297d5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 08:48:39 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 0.631s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a761db2b-12d5-4bbc-817c-957d6ec04c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8582bb-7705-4517-a9af-95a2e4376ffb]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:39 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:39 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 08:48:39 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Image download 20.69 MB at 20.69 MB/s Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d081bc-730e-44f5-b4bf-f4e0a775a88c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:39 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD Aug 28 08:48:39 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:39 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 0.654s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:39 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d Aug 28 08:48:39 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:39 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:39 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 is fetched for user 43c285adb7a94a25b82200210a1a05ce. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713bc94-6652-43b0-b282-74838dd0ab3b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:40 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD Aug 28 08:48:40 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:40 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:40 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Flow 'volume_create_manager' (1f6c0f66-1868-4aaa-a854-acf5245c5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eac46e3-6389-4bea-9367-286af8e5278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eac46e3-6389-4bea-9367-286af8e5278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-869542569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528bcdcf-3482-490b-b571-a51a14dbcfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f82c06a53c34a439b0f93f0d3f67bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:40Z,use_quota=True,user_id='d5771c89595f42d7a988140e0371496a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967aef88-2ec5-4da3-ada9-13a7fe6d1dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967aef88-2ec5-4da3-ada9-13a7fe6d1dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b2d3a3-332c-4cea-b400-d88a5220ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b2d3a3-332c-4cea-b400-d88a5220ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528bcdcf-3482-490b-b571-a51a14dbcfc9', 'volume_name': 'volume-528bcdcf-3482-490b-b571-a51a14dbcfc9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d625fd3-b822-422b-9819-0ba759464c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d625fd3-b822-422b-9819-0ba759464c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518747f-68ee-49b7-9988-3a306e43df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Volume 528bcdcf-3482-490b-b571-a51a14dbcfc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528bcdcf-3482-490b-b571-a51a14dbcfc9', 'volume_size': 1} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:40 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:40 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.536s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:48:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:48:48 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d" returned: 0 in 8.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:48:48 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Converted 1024.00 MB image at 122.66 MB/s Aug 28 08:48:48 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d is being set with open permissions: ugo+rw Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:48 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d Aug 28 08:48:48 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:48 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d" returned: 0 in 0.301s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" released by "_copy_volume_from_snapshot" :: held 10.132s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4-c81b5022-d648-4bf2-8c73-f5f5e27b938d" released by "_create_volume_from_snapshot" :: held 10.257s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.311s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.716s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-869542569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528bcdcf-3482-490b-b571-a51a14dbcfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f82c06a53c34a439b0f93f0d3f67bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:40Z,use_quota=True,user_id='d5771c89595f42d7a988140e0371496a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Creating volume 528bcdcf-3482-490b-b571-a51a14dbcfc9 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:48 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:48 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 1073741824 Aug 28 08:48:48 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d5775-44e9-40f1-be45-391991b3a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d', 'volume_size': 1, 'snapshot_id': 'f76a6381-37fd-4fb6-8748-f57f99145ff4'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7939eb8d-a2ad-4f4f-a866-4aed27a17885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:48 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Volume volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d (c81b5022-d648-4bf2-8c73-f5f5e27b938d): created successfully Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7939eb8d-a2ad-4f4f-a866-4aed27a17885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Flow 'volume_create_manager' (f81afee1-fd78-421c-adbc-b0e6ca2f9fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-99d4ec68-5b7c-47ca-96fb-ac5849aa1520 tempest-VolumesSnapshotTestJSON-943788347 None] Created volume successfully. Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-c81b5022-d648-4bf2-8c73-f5f5e27b938d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-c81b5022-d648-4bf2-8c73-f5f5e27b938d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:49 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 1073741824" returned: 0 in 0.787s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" acquired by "delete_volume" :: waited 0.052s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9346de5e-d3bd-4dfc-a535-00e245ab86aa]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:49 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 Aug 28 08:48:49 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:49 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d Aug 28 08:48:49 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:49 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9" returned: 0 in 0.538s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.052s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-214347065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c07d4c-8227-4b5e-8f2f-4442c5e1ef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7440c071a97a48009cf92feba9820db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:48:38Z,use_quota=True,user_id='43c285adb7a94a25b82200210a1a05ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Creating volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:48:49 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:48:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518747f-68ee-49b7-9988-3a306e43df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528bcdcf-3482-490b-b571-a51a14dbcfc9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:50 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1073741824 Aug 28 08:48:50 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d8e3be-85cc-49b5-ba1a-b2d2daccfd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:50 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Volume volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 (528bcdcf-3482-490b-b571-a51a14dbcfc9): created successfully Aug 28 08:48:50 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d8e3be-85cc-49b5-ba1a-b2d2daccfd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Flow 'volume_create_manager' (1f6c0f66-1868-4aaa-a854-acf5245c5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d" returned: 0 in 0.817s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:50 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d Aug 28 08:48:50 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f42c4dfe-9af0-4226-8889-afc472e9aa54 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Created volume successfully. Aug 28 08:48:50 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c81b5022-d648-4bf2-8c73-f5f5e27b938d" returned: 0 in 0.513s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c81b5022-d648-4bf2-8c73-f5f5e27b938d" released by "delete_volume" :: held 1.413s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:50 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1073741824" returned: 0 in 0.844s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['43cf9d1c-5c16-4d2e-80bb-d138098f3bcd', '7036645e-0576-4166-8443-9b9aa8e4893c', '248bc2b0-caea-49c0-a63b-a710d5f3bb65', 'beb5aca4-940c-4087-90cd-18018054fb41'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:50 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 Aug 28 08:48:50 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:51 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:51 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:51 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" returned: 0 in 0.600s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Attempting download of f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b7154-b702-4aa1-b3b3-a0bcdb6d0e8f]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:51 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.703s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Deleted volume successfully. Aug 28 08:48:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-f76a6381-37fd-4fb6-8748-f57f99145ff4-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:52 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32 Aug 28 08:48:52 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84dc06e3-89a3-4514-b768-10a1a25189fe tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-c81b5022-d648-4bf2-8c73-f5f5e27b938d-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-f76a6381-37fd-4fb6-8748-f57f99145ff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.128s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Deleting offline snapshot f76a6381-37fd-4fb6-8748-f57f99145ff4 of volume a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] snapshot_file for this snap is: volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a895783-faf3-4289-936b-ff6e59f164c6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:52 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:52 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:52 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32" returned: 0 in 0.761s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:52 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32 Aug 28 08:48:52 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Acquiring lock "cinder-528bcdcf-3482-490b-b571-a51a14dbcfc9-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "cinder-528bcdcf-3482-490b-b571-a51a14dbcfc9-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Acquiring lock "cinder-quobyte-528bcdcf-3482-490b-b571-a51a14dbcfc9" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "cinder-quobyte-528bcdcf-3482-490b-b571-a51a14dbcfc9" acquired by "delete_volume" :: waited 0.048s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:53 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 1.122s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a761db2b-12d5-4bbc-817c-957d6ec04c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16aca4-f1f7-42e3-8e9e-12a6bf0c030b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f772087e-b469-4fb8-811d-f8e7979ae2c3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:53 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32" returned: 1 in 0.931s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6hw0ms32' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbba3d8-d6e7-4109-8b8b-f9edbf3c651f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:53 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:53 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:53 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD Aug 28 08:48:53 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:53 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 Aug 28 08:48:53 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:54 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:54 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] f08659ba-d34f-40d3-9342-92af7297d5d7 was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 08:48:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:54 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 Aug 28 08:48:54 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:54 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9" returned: 0 in 1.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:54 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9 Aug 28 08:48:54 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:55 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 1.660s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:55 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:55 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:55 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-528bcdcf-3482-490b-b571-a51a14dbcfc9" returned: 0 in 0.578s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "cinder-quobyte-528bcdcf-3482-490b-b571-a51a14dbcfc9" released by "delete_volume" :: held 2.078s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Created reservations ['1b170f6d-e060-409d-a404-125c4094439c', '14a0bd83-a5a5-496d-a5e3-a2de1df4a671', '9a33d734-e7c5-4222-b848-c50797445ba3', '67243c5e-b919-4c09-aa6e-7a895d694eef'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:48:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:55 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:48:55 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:56 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 0.919s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:56 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4 Aug 28 08:48:56 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:56 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:56 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49.f76a6381-37fd-4fb6-8748-f57f99145ff4" returned: 0 in 0.596s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.894s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:48:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Deleted volume successfully. Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-f76a6381-37fd-4fb6-8748-f57f99145ff4" released by "_delete_snapshot" :: held 4.579s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" released by "delete_snapshot" :: held 4.643s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-61ee5ac3-82ac-4acf-8dec-1c5e371e33b5 tempest-VolumeQuotasNegativeTestJSON-1557463722 None] Lock "cinder-528bcdcf-3482-490b-b571-a51a14dbcfc9-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['b07b6e55-a77d-4c4e-90e6-9ed634d9ebe7', '62f0ded1-0115-426a-9e02-9b1c43bce02a', '68ff9438-d5aa-46c2-a1a4-0c4bb54463a8', '92161ad8-32dc-49bf-ae9a-b20b77e0816d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:48:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Delete snapshot completed successfully. Aug 28 08:48:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5c9c69e-9cca-49ca-86a3-57b53c52fed5 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-f76a6381-37fd-4fb6-8748-f57f99145ff4-delete_snapshot" released by "delete_snapshot" :: held 5.137s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-a761db2b-12d5-4bbc-817c-957d6ec04c49-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-a761db2b-12d5-4bbc-817c-957d6ec04c49-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e159653-2847-41b7-b4bd-648686967f6d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:58 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" returned: 0 in 4.113s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_oexlx1w8devstack@QuobyteHD, size 112.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:48:58 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Converted 112.00 MB image at 27.20 MB/s Aug 28 08:48:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:58 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1G Aug 28 08:48:58 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:58 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:58 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:59 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 0.752s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:48:59 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49 Aug 28 08:48:59 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:48:59 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 1G" returned: 0 in 1.042s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Downloaded image f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 for user 43c285adb7a94a25b82200210a1a05ce is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Marking volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Copying metadata from image f08659ba-d34f-40d3-9342-92af7297d5d7 to 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Creating volume glance metadata for volume 94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 backed by image f08659ba-d34f-40d3-9342-92af7297d5d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 08:48:59 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a761db2b-12d5-4bbc-817c-957d6ec04c49" returned: 0 in 0.725s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-a761db2b-12d5-4bbc-817c-957d6ec04c49" released by "delete_volume" :: held 1.627s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb976ca-6e83-4726-8c81-d919b2c8ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:48:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8016b02b-654a-42ce-b08d-76b1782bf0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:48:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Volume volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 (94c07d4c-8227-4b5e-8f2f-4442c5e1ef03): created successfully Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8016b02b-654a-42ce-b08d-76b1782bf0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Flow 'volume_create_manager' (28c3c7ca-7acc-4bad-b1ff-a0e8d4cc8a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['62d64816-28a5-4330-b889-27e04b80bd6d', 'b1ced7ea-7750-4570-b13b-905524e18e4e', '3f33bace-6836-4fa6-8554-9829202d256d', 'a9e31e31-db40-4051-bc77-e6067c89397b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3407d9b3-dc42-4b63-9eb4-cc396ef3f5ff tempest-VolumesImageMetadata-874985216 None] Created volume successfully. Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:00 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:00 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:00 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Deleted volume successfully. Aug 28 08:49:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ab8574fb-3f98-416a-a72e-d32add495c6e tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-a761db2b-12d5-4bbc-817c-957d6ec04c49-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-c628634c-1d1f-4035-a065-27eed110d00a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-c628634c-1d1f-4035-a065-27eed110d00a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[28463147-a1be-4558-b01f-f8a8f099934c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:01 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a Aug 28 08:49:01 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Acquiring lock "cinder-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "cinder-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Acquiring lock "cinder-quobyte-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "cinder-quobyte-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d907f024-2391-49d8-a96e-2d372bc54543]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:02 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a" returned: 0 in 1.103s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:02 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a Aug 28 08:49:02 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:02 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 Aug 28 08:49:02 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:02 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c628634c-1d1f-4035-a065-27eed110d00a" returned: 0 in 0.507s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-quobyte-c628634c-1d1f-4035-a065-27eed110d00a" released by "delete_volume" :: held 1.795s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Created reservations ['7c21edd7-ec4f-4571-991b-e9c342ea1a91', '3fc30d91-232b-42e5-9bdb-dd56d7e91cd0', 'ec9ad0f8-219c-4c02-ab8d-efa6244a1784', '331d77d6-cb5b-414e-9be5-fa2c64a4291c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:03 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:03 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" returned: 0 in 1.030s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:03 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:03 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03 Aug 28 08:49:03 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:03 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.455s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Deleted volume successfully. Aug 28 08:49:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b167bc68-f1a8-4700-8610-b756419e8696 tempest-VolumesSnapshotTestJSON-943788347 None] Lock "cinder-c628634c-1d1f-4035-a065-27eed110d00a-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:04 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" returned: 0 in 0.757s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "cinder-quobyte-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03" released by "delete_volume" :: held 1.887s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Created reservations ['f0c48aef-d2f5-4992-a3bd-5707ffe15a0d', '150bf391-c62b-4e04-b072-198776653e67', '86e005c6-0eae-4a57-9d20-dc14c1adc72c', '8d574c3d-5d14-40d9-8572-2f001cfa4c5d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:04 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:04 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:05 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.642s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:05 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Deleted volume successfully. Aug 28 08:49:05 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=120,cinder:INSERT=49,cinder:UPDATE=130,cinder:DELETE=10 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:49:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1f411486-e6ce-458b-924d-970b1d881662 tempest-VolumesImageMetadata-874985216 None] Lock "cinder-94c07d4c-8227-4b5e-8f2f-4442c5e1ef03-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:08 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=119,cinder:INSERT=41,cinder:UPDATE=139,cinder:DELETE=12 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:49:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-d6dc2ba2-bb9c-4b7e-93ef-5b615154d4c6 tempest-ServerActionsTestOtherA-768164863 None] Terminate volume connection completed successfully. Aug 28 08:49:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-d6dc2ba2-bb9c-4b7e-93ef-5b615154d4c6 tempest-ServerActionsTestOtherA-768164863 None] Deleting attachment 4c605568-b5be-47de-836a-cc8d0ca3b156. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Flow 'volume_create_manager' (9cd982aa-a360-4e62-a30b-8233d85c4f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a75b169-9ac8-4731-b152-79e97817315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a75b169-9ac8-4731-b152-79e97817315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1392942535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee930a7-68d5-45a2-b25b-edaf518b4232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df0482339224272b30258ada4d076b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:11Z,use_quota=True,user_id='46f0f4b971a2430daa9b4b388bb061af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893faf21-2198-4e33-a0e9-5b5fce90f51c),volume_type_id=893faf21-2198-4e33-a0e9-5b5fce90f51c)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32301839-dfa3-4d3d-b5ce-5be315e6d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32301839-dfa3-4d3d-b5ce-5be315e6d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550f0b03-8120-497f-b249-8800d59da82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550f0b03-8120-497f-b249-8800d59da82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee930a7-68d5-45a2-b25b-edaf518b4232', 'volume_name': 'volume-9ee930a7-68d5-45a2-b25b-edaf518b4232', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c60eb1-b129-488d-a417-af608ac6206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c60eb1-b129-488d-a417-af608ac6206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27edbb9-b753-4670-896a-60b997b2f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:10 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Volume 9ee930a7-68d5-45a2-b25b-edaf518b4232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee930a7-68d5-45a2-b25b-edaf518b4232', 'volume_size': 1} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1392942535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee930a7-68d5-45a2-b25b-edaf518b4232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df0482339224272b30258ada4d076b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:11Z,use_quota=True,user_id='46f0f4b971a2430daa9b4b388bb061af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893faf21-2198-4e33-a0e9-5b5fce90f51c),volume_type_id=893faf21-2198-4e33-a0e9-5b5fce90f51c)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Creating volume 9ee930a7-68d5-45a2-b25b-edaf518b4232 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:10 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-31d7f894-dc4b-4af3-924d-3108d38da9d1 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:11 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 1073741824 Aug 28 08:49:11 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:11 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 1073741824" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:11 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 Aug 28 08:49:11 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:12 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-31d7f894-dc4b-4af3-924d-3108d38da9d1 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.023s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27edbb9-b753-4670-896a-60b997b2f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee930a7-68d5-45a2-b25b-edaf518b4232', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a39ff6-070b-4f9c-900e-b3d022aebd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-31d7f894-dc4b-4af3-924d-3108d38da9d1 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:12 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Volume volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 (9ee930a7-68d5-45a2-b25b-edaf518b4232): created successfully Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a39ff6-070b-4f9c-900e-b3d022aebd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Flow 'volume_create_manager' (9cd982aa-a360-4e62-a30b-8233d85c4f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-49866f04-9dc9-4fdf-b412-749c6c3ef835 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Created volume successfully. Aug 28 08:49:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-31d7f894-dc4b-4af3-924d-3108d38da9d1 tempest-ServerActionsTestOtherA-768164863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-5ae66753-e6f3-4369-b150-6f445b46a1bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2fcc0b1-9e72-4a61-bf2f-18c5cfb5f804', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:49:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-42d52a5a-f349-48bf-a25f-6a8dd4c107ca req-31d7f894-dc4b-4af3-924d-3108d38da9d1 tempest-ServerActionsTestOtherA-768164863 None] attachment_update completed successfully. Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:13 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:13 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:14 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.524s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:14 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-597f4574-f926-4b48-8ea9-63e14fc1406f tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Retype volume completed successfully. Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "cinder-9ee930a7-68d5-45a2-b25b-edaf518b4232-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "cinder-9ee930a7-68d5-45a2-b25b-edaf518b4232-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "cinder-quobyte-9ee930a7-68d5-45a2-b25b-edaf518b4232" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "cinder-quobyte-9ee930a7-68d5-45a2-b25b-edaf518b4232" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909193f-5b47-419b-b5bc-765425a3c022]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:15 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 Aug 28 08:49:15 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:16 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232" returned: 0 in 0.824s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:16 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232 Aug 28 08:49:16 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:16 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9ee930a7-68d5-45a2-b25b-edaf518b4232" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "cinder-quobyte-9ee930a7-68d5-45a2-b25b-edaf518b4232" released by "delete_volume" :: held 1.351s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:16 devstack cinder-volume[85762]: WARNING cinder.quota [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:49:16 devstack cinder-volume[85762]: WARNING cinder.quota [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Created reservations ['9a3a5d5e-9bd2-4530-8995-00afaceef1c6', 'c047ba34-22c3-4008-9811-e46b8ef6795a', 'cf240176-a20a-4e99-8233-3e17697b15dc', '6e815e6b-f9ec-4d9b-8fa6-b3283e183835'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:17 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:17 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Flow 'volume_create_manager' (8e178bc1-c709-4de9-942f-f100a63c35e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3a0372-e947-49fd-9d34-c65bdb4c5fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3a0372-e947-49fd-9d34-c65bdb4c5fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1225668042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595b6dd-ce06-4f7d-985d-207e109a0791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9627c491cef4fab841ffda677c6daba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:17Z,use_quota=True,user_id='2308cf9cde7744b281374aa3ff45c239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd651fb3-206d-418f-baad-de0ca177fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd651fb3-206d-418f-baad-de0ca177fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fa1090-d8f1-4c1c-bb46-903d1b48e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fa1090-d8f1-4c1c-bb46-903d1b48e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9595b6dd-ce06-4f7d-985d-207e109a0791', 'volume_name': 'volume-9595b6dd-ce06-4f7d-985d-207e109a0791', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a087cdc5-7d6a-457a-ae6b-e5d83c47a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a087cdc5-7d6a-457a-ae6b-e5d83c47a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaa2111-aa6e-40b5-9a4b-d2d97c005a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Volume 9595b6dd-ce06-4f7d-985d-207e109a0791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9595b6dd-ce06-4f7d-985d-207e109a0791', 'volume_size': 1} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1225668042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595b6dd-ce06-4f7d-985d-207e109a0791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9627c491cef4fab841ffda677c6daba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:17Z,use_quota=True,user_id='2308cf9cde7744b281374aa3ff45c239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Creating volume 9595b6dd-ce06-4f7d-985d-207e109a0791 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:17 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:17 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.840s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Deleted volume successfully. Aug 28 08:49:17 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 1073741824 Aug 28 08:49:17 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-254bb697-6a48-4910-918b-2cdad177a380 tempest-VolumeRetypeWithoutMigrationTest-825185762 None] Lock "cinder-9ee930a7-68d5-45a2-b25b-edaf518b4232-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:18 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 1073741824" returned: 0 in 1.048s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:18 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 Aug 28 08:49:18 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:19 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791" returned: 0 in 0.448s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbaa2111-aa6e-40b5-9a4b-d2d97c005a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9595b6dd-ce06-4f7d-985d-207e109a0791', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a77b6-2f6c-485a-ab10-614b162549d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Volume volume-9595b6dd-ce06-4f7d-985d-207e109a0791 (9595b6dd-ce06-4f7d-985d-207e109a0791): created successfully Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a77b6-2f6c-485a-ab10-614b162549d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Flow 'volume_create_manager' (8e178bc1-c709-4de9-942f-f100a63c35e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5084cd51-fa45-4e8c-8a08-248c8ecc1d56 tempest-AbsoluteLimitsTests-1302964202 None] Created volume successfully. Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Acquiring lock "cinder-9595b6dd-ce06-4f7d-985d-207e109a0791-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "cinder-9595b6dd-ce06-4f7d-985d-207e109a0791-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Acquiring lock "cinder-quobyte-9595b6dd-ce06-4f7d-985d-207e109a0791" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "cinder-quobyte-9595b6dd-ce06-4f7d-985d-207e109a0791" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d685c14f-0b36-4c4d-a6cd-7a8bddfe2cc0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:20 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 Aug 28 08:49:20 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:21 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791" returned: 0 in 0.901s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:21 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791 Aug 28 08:49:21 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:22 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9595b6dd-ce06-4f7d-985d-207e109a0791" returned: 0 in 0.716s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "cinder-quobyte-9595b6dd-ce06-4f7d-985d-207e109a0791" released by "delete_volume" :: held 1.708s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Created reservations ['c4789ea0-e4f1-4f3b-abf6-f6e557e0f9b1', 'c21f843d-0423-4834-af2e-15105a04eda3', 'e70f2370-272b-4183-be99-6eaec1310034', '0a9634f9-8242-4973-9379-fd6753b9d6d8'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:22 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:22 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:23 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.621s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:23 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Deleted volume successfully. Aug 28 08:49:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c9f588ce-a5f5-402e-b5bb-20a803df0bad tempest-AbsoluteLimitsTests-1302964202 None] Lock "cinder-9595b6dd-ce06-4f7d-985d-207e109a0791-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Flow 'volume_create_manager' (8dfb6fbb-08cf-4c01-bb11-3b832229a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056bab01-d4da-48f3-aee9-ad60690e43e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056bab01-d4da-48f3-aee9-ad60690e43e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1446445535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b529fb-ae20-4983-b3dc-010ad7774161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15b34f9776bc42f183a25b6c14fef920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:32Z,use_quota=True,user_id='6d5737d714f949ba8ee7200ef44d0a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df7b22cc-c1e2-4e7d-ab59-c89f5245604a),volume_type_id=df7b22cc-c1e2-4e7d-ab59-c89f5245604a)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ea756-1147-49bf-8a0e-09ef0627af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ea756-1147-49bf-8a0e-09ef0627af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c4245b-2d7f-43b0-b47d-c75c01b82113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c4245b-2d7f-43b0-b47d-c75c01b82113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b529fb-ae20-4983-b3dc-010ad7774161', 'volume_name': 'volume-b4b529fb-ae20-4983-b3dc-010ad7774161', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea09d8de-681d-4a08-9db9-98ecacf3608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea09d8de-681d-4a08-9db9-98ecacf3608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d3782c-2dc3-42e5-a41d-7e7ca6b50537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Volume b4b529fb-ae20-4983-b3dc-010ad7774161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b529fb-ae20-4983-b3dc-010ad7774161', 'volume_size': 1} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1446445535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b529fb-ae20-4983-b3dc-010ad7774161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15b34f9776bc42f183a25b6c14fef920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:32Z,use_quota=True,user_id='6d5737d714f949ba8ee7200ef44d0a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df7b22cc-c1e2-4e7d-ab59-c89f5245604a),volume_type_id=df7b22cc-c1e2-4e7d-ab59-c89f5245604a)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Creating volume b4b529fb-ae20-4983-b3dc-010ad7774161 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:32 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:32 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 1073741824 Aug 28 08:49:32 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:33 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 1073741824" returned: 0 in 1.012s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:33 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 Aug 28 08:49:33 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:34 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161" returned: 0 in 0.845s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d3782c-2dc3-42e5-a41d-7e7ca6b50537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b529fb-ae20-4983-b3dc-010ad7774161', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03d2886-6317-4b31-bd3d-665ee0266055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:34 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Volume volume-b4b529fb-ae20-4983-b3dc-010ad7774161 (b4b529fb-ae20-4983-b3dc-010ad7774161): created successfully Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03d2886-6317-4b31-bd3d-665ee0266055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Flow 'volume_create_manager' (8dfb6fbb-08cf-4c01-bb11-3b832229a77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5e87cf34-6820-4717-ad7f-141d61663999 tempest-VolumeTypesAccessTest-1382374229 None] Created volume successfully. Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Acquiring lock "cinder-b4b529fb-ae20-4983-b3dc-010ad7774161-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "cinder-b4b529fb-ae20-4983-b3dc-010ad7774161-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Acquiring lock "cinder-quobyte-b4b529fb-ae20-4983-b3dc-010ad7774161" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "cinder-quobyte-b4b529fb-ae20-4983-b3dc-010ad7774161" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8d0f19-1bfe-44a9-a243-c3b583085f28]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:36 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 Aug 28 08:49:36 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:36 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161" returned: 0 in 0.554s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:36 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161 Aug 28 08:49:36 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:36 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b4b529fb-ae20-4983-b3dc-010ad7774161" returned: 0 in 0.475s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "cinder-quobyte-b4b529fb-ae20-4983-b3dc-010ad7774161" released by "delete_volume" :: held 1.119s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:37 devstack cinder-volume[85762]: WARNING cinder.quota [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-590827428 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-590827428, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:49:37 devstack cinder-volume[85762]: WARNING cinder.quota [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-590827428 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-590827428, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Created reservations ['3cce02bc-9226-4a57-9df1-908f8b1be37b', '2d4dd564-ed1a-4db4-a834-0e42dd77407e', '840c18a9-8d29-4c74-921d-404c62dbced7', 'cca1872e-bcf9-4039-b955-c3dd12a2d4ed'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:37 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:37 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:37 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.415s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Deleted volume successfully. Aug 28 08:49:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cf0b1787-5d94-4792-a815-e55d80e81b45 tempest-VolumeTypesAccessTest-1382374229 None] Lock "cinder-b4b529fb-ae20-4983-b3dc-010ad7774161-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Flow 'volume_create_manager' (6abbf65f-c180-4443-a5b8-9c2760f2092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e44e84-e893-42d0-974d-45eea15fcb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e44e84-e893-42d0-974d-45eea15fcb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1218260247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c591c800-0c42-4a3f-a95f-5c515f6d564a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3464e63ff590492bad9727765d831a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:38Z,use_quota=True,user_id='ef91c38924bd43e6acfba3895e434c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e02c28-4fa6-4a0c-bc65-e6f833fd0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e02c28-4fa6-4a0c-bc65-e6f833fd0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a8910-4bd6-48d0-95df-8b21f7a1dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540a8910-4bd6-48d0-95df-8b21f7a1dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c591c800-0c42-4a3f-a95f-5c515f6d564a', 'volume_name': 'volume-c591c800-0c42-4a3f-a95f-5c515f6d564a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4778d9a-e16d-44d1-b32b-5de5b4d26659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4778d9a-e16d-44d1-b32b-5de5b4d26659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474388d4-cb6b-4128-bf5a-de5e5cc61470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Volume c591c800-0c42-4a3f-a95f-5c515f6d564a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c591c800-0c42-4a3f-a95f-5c515f6d564a', 'volume_size': 1} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1218260247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c591c800-0c42-4a3f-a95f-5c515f6d564a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3464e63ff590492bad9727765d831a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:38Z,use_quota=True,user_id='ef91c38924bd43e6acfba3895e434c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Creating volume c591c800-0c42-4a3f-a95f-5c515f6d564a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:38 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:38 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a 1073741824 Aug 28 08:49:38 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:39 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a 1073741824" returned: 0 in 0.724s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:39 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a Aug 28 08:49:39 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:39 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a" returned: 0 in 0.402s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474388d4-cb6b-4128-bf5a-de5e5cc61470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c591c800-0c42-4a3f-a95f-5c515f6d564a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b6a733-c7a9-4022-9554-37f59afca737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Volume volume-c591c800-0c42-4a3f-a95f-5c515f6d564a (c591c800-0c42-4a3f-a95f-5c515f6d564a): created successfully Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b6a733-c7a9-4022-9554-37f59afca737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Flow 'volume_create_manager' (6abbf65f-c180-4443-a5b8-9c2760f2092f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:39 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-755065e9-a255-4210-9616-7ff0ba961af1 tempest-VolumesTransfersV355Test-271379900 None] Created volume successfully. Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:40 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:40 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:40 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.420s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:49:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:49:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-49f20a36-fdf3-49f1-8b74-2198cfa26ac9 tempest-VolumesTransfersV355Test-242926554 None] Transfer volume completed successfully. Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "cinder-c591c800-0c42-4a3f-a95f-5c515f6d564a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-c591c800-0c42-4a3f-a95f-5c515f6d564a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "cinder-quobyte-c591c800-0c42-4a3f-a95f-5c515f6d564a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-quobyte-c591c800-0c42-4a3f-a95f-5c515f6d564a" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d038239-e3e9-4c2c-8fba-96a4577167eb]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:42 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a Aug 28 08:49:42 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:43 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a" returned: 0 in 0.519s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:43 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a Aug 28 08:49:43 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:43 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c591c800-0c42-4a3f-a95f-5c515f6d564a" returned: 0 in 0.448s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-quobyte-c591c800-0c42-4a3f-a95f-5c515f6d564a" released by "delete_volume" :: held 1.039s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Created reservations ['9294eb31-e5a5-4d0d-a64e-a6a16b36e622', '8eb8e119-da58-43df-a589-418528352dde', 'a7df834f-9cb1-4853-9198-112ccdcf4602', 'f3e987cd-2b13-442c-91bb-6d63bc09bb2f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:43 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:43 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:44 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.439s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:44 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Deleted volume successfully. Aug 28 08:49:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-90227231-26ad-4232-b647-b5cd58d6e634 tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-c591c800-0c42-4a3f-a95f-5c515f6d564a-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Flow 'volume_create_manager' (bea52585-3040-41c8-b0a1-76783fda264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaac7d0-fddf-43d9-ae62-ef76c7a56287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaac7d0-fddf-43d9-ae62-ef76c7a56287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-330145751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf724f3c-2bc3-439c-adaf-665bb2b27a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3464e63ff590492bad9727765d831a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:46Z,use_quota=True,user_id='ef91c38924bd43e6acfba3895e434c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e57336-0af5-4528-b5a0-f70f54b175fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e57336-0af5-4528-b5a0-f70f54b175fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b77c8bb-87f4-4095-a0f1-3f78482c922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b77c8bb-87f4-4095-a0f1-3f78482c922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf724f3c-2bc3-439c-adaf-665bb2b27a44', 'volume_name': 'volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f008e09-d60b-4b8b-b77f-0342ed477e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f008e09-d60b-4b8b-b77f-0342ed477e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1503ecb-7e94-4e47-ba64-19ed78b69e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Volume bf724f3c-2bc3-439c-adaf-665bb2b27a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44', 'volume_size': 1} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-330145751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf724f3c-2bc3-439c-adaf-665bb2b27a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3464e63ff590492bad9727765d831a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:46Z,use_quota=True,user_id='ef91c38924bd43e6acfba3895e434c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Creating volume bf724f3c-2bc3-439c-adaf-665bb2b27a44 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:45 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 1073741824 Aug 28 08:49:45 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:46 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 1073741824" returned: 0 in 0.774s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:46 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 Aug 28 08:49:46 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:47 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1503ecb-7e94-4e47-ba64-19ed78b69e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2515d80-9544-481f-b2b3-8a446be50471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Volume volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 (bf724f3c-2bc3-439c-adaf-665bb2b27a44): created successfully Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2515d80-9544-481f-b2b3-8a446be50471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Flow 'volume_create_manager' (bea52585-3040-41c8-b0a1-76783fda264b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-708d457f-cab5-4fdc-9b4a-6640bb5c2208 tempest-VolumesTransfersV355Test-271379900 None] Created volume successfully. Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "cinder-bf724f3c-2bc3-439c-adaf-665bb2b27a44-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-bf724f3c-2bc3-439c-adaf-665bb2b27a44-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "cinder-quobyte-bf724f3c-2bc3-439c-adaf-665bb2b27a44" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-quobyte-bf724f3c-2bc3-439c-adaf-665bb2b27a44" acquired by "delete_volume" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a2d7b-b422-43e7-b1ec-d86e0150caa6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:49:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:49 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 Aug 28 08:49:49 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:49 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44" returned: 0 in 0.867s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:49 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44 Aug 28 08:49:49 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:50 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bf724f3c-2bc3-439c-adaf-665bb2b27a44" returned: 0 in 0.619s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-quobyte-bf724f3c-2bc3-439c-adaf-665bb2b27a44" released by "delete_volume" :: held 1.571s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Created reservations ['90e8e4c6-c5b2-41e8-a528-3bea4f5272f4', 'b538b9e5-62c4-4dca-9d74-31a594fd27dd', '2a183a89-b3b2-41c1-a951-e7dc9f9d948c', 'b410c231-727b-4c6e-8ed4-3ef6f397e4d6'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:50 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:49:50 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:51 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.449s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:49:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Deleted volume successfully. Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-64b68a43-fbea-4c00-920a-5132f5a03d2c tempest-VolumesTransfersV355Test-80924895 None] Lock "cinder-bf724f3c-2bc3-439c-adaf-665bb2b27a44-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Flow 'volume_create_manager' (ff4080ff-7be6-4cec-91be-f78e4f99a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b68c1-6fec-466b-a63a-7bf84c87d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b68c1-6fec-466b-a63a-7bf84c87d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1336448634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c21dd6e-2e4c-44e0-900d-613e4a1f1de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed89af3053649959f9b23f0cddd7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:51Z,use_quota=True,user_id='8a734df042874a77bc2da9f095f711cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77869673-6950-4215-92a7-142f7b3e186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77869673-6950-4215-92a7-142f7b3e186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c05ad06-c574-43c6-b61f-2d6c01156df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c05ad06-c574-43c6-b61f-2d6c01156df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c21dd6e-2e4c-44e0-900d-613e4a1f1de3', 'volume_name': 'volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629890d3-5ef2-48d6-bfda-c9ca7442f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629890d3-5ef2-48d6-bfda-c9ca7442f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a845887a-6de3-4072-87c0-db4eae04fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:51 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume 3c21dd6e-2e4c-44e0-900d-613e4a1f1de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3', 'volume_size': 1} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1336448634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c21dd6e-2e4c-44e0-900d-613e4a1f1de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed89af3053649959f9b23f0cddd7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:51Z,use_quota=True,user_id='8a734df042874a77bc2da9f095f711cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Creating volume 3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:51 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:51 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 1073741824 Aug 28 08:49:51 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Flow 'volume_create_manager' (6fd15e0c-3acc-4654-b6a6-f2cf5df1efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a4cb55-4224-4067-a75e-fa75ff130aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a4cb55-4224-4067-a75e-fa75ff130aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1980918392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94238d46-4f6a-48f3-aa43-cfafbb6169a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed89af3053649959f9b23f0cddd7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:52Z,use_quota=True,user_id='8a734df042874a77bc2da9f095f711cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345d6e55-e75c-445e-89cf-fc1fa904401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345d6e55-e75c-445e-89cf-fc1fa904401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3acc93-11d9-4a43-b6a6-5a5f96b4be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3acc93-11d9-4a43-b6a6-5a5f96b4be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94238d46-4f6a-48f3-aa43-cfafbb6169a2', 'volume_name': 'volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0fda70-7656-44d3-b9cd-21f74c58dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0fda70-7656-44d3-b9cd-21f74c58dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f923eec-9398-43d4-b64f-3c664bf1c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:52 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume 94238d46-4f6a-48f3-aa43-cfafbb6169a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2', 'volume_size': 1} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:52 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 1073741824" returned: 0 in 1.043s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:52 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 Aug 28 08:49:52 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:53 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" returned: 0 in 0.592s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1980918392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94238d46-4f6a-48f3-aa43-cfafbb6169a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed89af3053649959f9b23f0cddd7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:49:52Z,use_quota=True,user_id='8a734df042874a77bc2da9f095f711cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Creating volume 94238d46-4f6a-48f3-aa43-cfafbb6169a2 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:49:53 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:53 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 1073741824 Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a845887a-6de3-4072-87c0-db4eae04fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:53 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fa796e-f3df-4221-8ef3-a5a0b793fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:53 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 (3c21dd6e-2e4c-44e0-900d-613e4a1f1de3): created successfully Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fa796e-f3df-4221-8ef3-a5a0b793fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Flow 'volume_create_manager' (ff4080ff-7be6-4cec-91be-f78e4f99a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:53 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a66a767b-f192-4423-839b-bf3c7227481a tempest-TestServerVolumeAttachmentScenario-1150905160 None] Created volume successfully. Aug 28 08:49:54 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 1073741824" returned: 0 in 0.928s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:49:54 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 Aug 28 08:49:54 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:49:54 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Aug 28 08:49:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2" returned: 0 in 0.498s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:49:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:49:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:49:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f923eec-9398-43d4-b64f-3c664bf1c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9e13da-e3dc-4d63-a205-bb883184563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:49:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Volume volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 (94238d46-4f6a-48f3-aa43-cfafbb6169a2): created successfully Aug 28 08:49:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9e13da-e3dc-4d63-a205-bb883184563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:49:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Flow 'volume_create_manager' (6fd15e0c-3acc-4654-b6a6-f2cf5df1efeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:49:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ad918a26-867e-4a29-ae2a-13405ec982da tempest-TestServerVolumeAttachmentScenario-1150905160 None] Created volume successfully. Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Flow 'volume_create_manager' (f092df40-775c-4b08-905b-c1fb3bb4185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b86b9c-15c8-4be4-9034-4548a6f50ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b86b9c-15c8-4be4-9034-4548a6f50ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-157329448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc57159-ecfd-44d6-be34-6e098e117275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca13f1cc0244432b9a9287a7fb8d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:02Z,use_quota=True,user_id='ae848c8ede2747cbb27397e79f033c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd81e95f-b8aa-4f8f-a95d-4ab2244a4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd81e95f-b8aa-4f8f-a95d-4ab2244a4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b5dcf7-627c-49f2-aa61-3154c140c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b5dcf7-627c-49f2-aa61-3154c140c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc57159-ecfd-44d6-be34-6e098e117275', 'volume_name': 'volume-2cc57159-ecfd-44d6-be34-6e098e117275', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613f37a-e7ee-4dbd-b5da-2f5e099e7124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613f37a-e7ee-4dbd-b5da-2f5e099e7124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fe9929-5dde-4c6c-818a-58922c35fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Volume 2cc57159-ecfd-44d6-be34-6e098e117275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc57159-ecfd-44d6-be34-6e098e117275', 'volume_size': 1} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-157329448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc57159-ecfd-44d6-be34-6e098e117275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca13f1cc0244432b9a9287a7fb8d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:02Z,use_quota=True,user_id='ae848c8ede2747cbb27397e79f033c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Creating volume 2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:02 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:02 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 1073741824 Aug 28 08:50:02 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:03 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 1073741824" returned: 0 in 0.627s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:03 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:03 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:03 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fe9929-5dde-4c6c-818a-58922c35fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc57159-ecfd-44d6-be34-6e098e117275', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58379cbb-1ca7-4935-8b98-4a505798d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:03 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Volume volume-2cc57159-ecfd-44d6-be34-6e098e117275 (2cc57159-ecfd-44d6-be34-6e098e117275): created successfully Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58379cbb-1ca7-4935-8b98-4a505798d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Flow 'volume_create_manager' (f092df40-775c-4b08-905b-c1fb3bb4185a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0ba27bf0-57ea-4ec5-b44b-4f99a484b621 tempest-VolumesCloneTest-14806241 None] Created volume successfully. Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (38095858-fd18-4017-87b0-ad6a07637269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e9a21-224a-4c1c-89e8-5c90e6a2f887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e9a21-224a-4c1c-89e8-5c90e6a2f887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1347842354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705c657c-abad-4ddd-9afd-68ce413fa420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:05Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7801d440-cfcf-4adf-891d-4251c301398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7801d440-cfcf-4adf-891d-4251c301398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0523b55-124f-4f21-af5a-7ceadab5dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0523b55-124f-4f21-af5a-7ceadab5dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705c657c-abad-4ddd-9afd-68ce413fa420', 'volume_name': 'volume-705c657c-abad-4ddd-9afd-68ce413fa420', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafe5c73-7bf4-497f-9f3c-6ba05fdef943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafe5c73-7bf4-497f-9f3c-6ba05fdef943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c51d9-3182-49d7-9b3d-deffbb635d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Volume 705c657c-abad-4ddd-9afd-68ce413fa420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705c657c-abad-4ddd-9afd-68ce413fa420', 'volume_size': 1} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1347842354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705c657c-abad-4ddd-9afd-68ce413fa420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:05Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Creating volume 705c657c-abad-4ddd-9afd-68ce413fa420 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:05 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 1073741824 Aug 28 08:50:05 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:06 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 1073741824" returned: 0 in 1.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=57,cinder:UPDATE=64,cinder:DELETE=6,cinder:INSERT=12 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:06 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 Aug 28 08:50:06 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Flow 'volume_create_manager' (6b4d2295-f9ed-40a7-9748-eacdd05b2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c757cca-edd7-41f9-ac09-baccf279f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c757cca-edd7-41f9-ac09-baccf279f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21505786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4583cd8d-abef-496f-a813-6675c3fb1394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca13f1cc0244432b9a9287a7fb8d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2cc57159-ecfd-44d6-be34-6e098e117275,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:07Z,use_quota=True,user_id='ae848c8ede2747cbb27397e79f033c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb66a0-309e-47ae-adac-739faa449321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb66a0-309e-47ae-adac-739faa449321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a9928-3bb8-4d90-92d0-2c1b952c8e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845a9928-3bb8-4d90-92d0-2c1b952c8e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4583cd8d-abef-496f-a813-6675c3fb1394', 'volume_name': 'volume-4583cd8d-abef-496f-a813-6675c3fb1394', 'volume_size': 2, 'source_volid': '2cc57159-ecfd-44d6-be34-6e098e117275', 'source_volstatus': 'available'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7a02d5-a297-4bae-bb70-cc4fa342ef88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7a02d5-a297-4bae-bb70-cc4fa342ef88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f1550c-c436-4170-9ce8-862dfabb52b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:07 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Volume 4583cd8d-abef-496f-a813-6675c3fb1394: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4583cd8d-abef-496f-a813-6675c3fb1394', 'volume_size': 2, 'source_volid': '2cc57159-ecfd-44d6-be34-6e098e117275', 'source_volstatus': 'available'} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:07 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420" returned: 0 in 0.504s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.225s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:07 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Cloning volume 2cc57159-ecfd-44d6-be34-6e098e117275 to volume 4583cd8d-abef-496f-a813-6675c3fb1394 Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c51d9-3182-49d7-9b3d-deffbb635d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705c657c-abad-4ddd-9afd-68ce413fa420', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611a4e17-f5af-4d8f-8b19-ff1838384148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:07 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Volume volume-705c657c-abad-4ddd-9afd-68ce413fa420 (705c657c-abad-4ddd-9afd-68ce413fa420): created successfully Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611a4e17-f5af-4d8f-8b19-ff1838384148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (38095858-fd18-4017-87b0-ad6a07637269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Creating offline snapshot 62d97431-ac04-4586-b453-46cadeecaa56 of volume 2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:50:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2ba6f6f1-0f35-4dd9-8a5f-044514a033b2 tempest-VolumesListAdminTestJSON-1251157175 None] Created volume successfully. Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a5627-bd46-42d9-bb33-e53b5121aef8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:07 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:07 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:07 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.510s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:08 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 1G Aug 28 08:50:08 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:08 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 1G" returned: 0 in 0.760s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc57159-ecfd-44d6-be34-6e098e117275 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:08 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc57159-ecfd-44d6-be34-6e098e117275 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:08 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=81,cinder:SELECT=64,cinder:INSERT=17,cinder:DELETE=7 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (42af394b-9179-4396-82a2-016ba887787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb85dc5-6599-4e19-8893-cb6134fb4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb85dc5-6599-4e19-8893-cb6134fb4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094434609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc886b4-1973-4d0b-a572-200a3b614d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:09Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a11a6-58ba-4062-8bfe-4bbed72c0e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a11a6-58ba-4062-8bfe-4bbed72c0e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a38401-76c4-4869-b24a-dc22da74e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a38401-76c4-4869-b24a-dc22da74e207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc886b4-1973-4d0b-a572-200a3b614d58', 'volume_name': 'volume-bdc886b4-1973-4d0b-a572-200a3b614d58', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7ecede-30b1-43f4-aae9-d28493817789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7ecede-30b1-43f4-aae9-d28493817789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:09 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1585333e-24b3-42fb-bb0a-0aed6d70346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Volume bdc886b4-1973-4d0b-a572-200a3b614d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc886b4-1973-4d0b-a572-200a3b614d58', 'volume_size': 1} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc57159-ecfd-44d6-be34-6e098e117275 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.681s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:09 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 is being set with open permissions: ugo+rw Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:09 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:09 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:09 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.378s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:09 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info Aug 28 08:50:09 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:10 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:10 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info is being set with open permissions: ugo+rw Aug 28 08:50:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:10 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info Aug 28 08:50:10 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:10 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.info" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] snapshot: 62d97431-ac04-4586-b453-46cadeecaa56, volume: 4583cd8d-abef-496f-a813-6675c3fb1394, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d33c99-f9d9-428e-9e5f-6e7d56a9728f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:11 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:11 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:11 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.635s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cc57159-ecfd-44d6-be34-6e098e117275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[401be775-2640-4537-a49b-6b5dcd86eb63]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:11 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:11 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:12 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.445s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:50:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:50:12 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:50:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:12 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 Aug 28 08:50:12 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:19 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=4,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:50:19 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=1,cinder:INSERT=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:50:20 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394" returned: 0 in 7.872s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:50:20 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Converted 1024.00 MB image at 130.07 MB/s Aug 28 08:50:20 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 is being set with open permissions: ugo+rw Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:20 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 Aug 28 08:50:20 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:20 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394" returned: 0 in 0.327s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" released by "_copy_volume_from_snapshot" :: held 9.396s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-quobyte-62d97431-ac04-4586-b453-46cadeecaa56" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-62d97431-ac04-4586-b453-46cadeecaa56" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Deleting offline snapshot 62d97431-ac04-4586-b453-46cadeecaa56 of volume 2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] snapshot_file for this snap is: volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b4a897-4a1d-4211-b741-c79a451355ca]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:20 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:20 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:21 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.612s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cc57159-ecfd-44d6-be34-6e098e117275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe77e0a-facb-4b5a-aa13-7fd077652afe]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:21 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:21 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:21 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.680s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:21 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:21 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:22 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.494s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:22 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56 Aug 28 08:50:22 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:22 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275.62d97431-ac04-4586-b453-46cadeecaa56" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-62d97431-ac04-4586-b453-46cadeecaa56" released by "_delete_snapshot" :: held 2.261s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.434s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.331s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094434609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc886b4-1973-4d0b-a572-200a3b614d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:09Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Creating volume bdc886b4-1973-4d0b-a572-200a3b614d58 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:22 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f1550c-c436-4170-9ce8-862dfabb52b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4583cd8d-abef-496f-a813-6675c3fb1394', 'volume_size': 2, 'source_volid': '2cc57159-ecfd-44d6-be34-6e098e117275', 'source_volstatus': 'available'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ed791f-7cb9-400d-8fc4-c049630338e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:22 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 1073741824 Aug 28 08:50:22 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Volume volume-4583cd8d-abef-496f-a813-6675c3fb1394 (4583cd8d-abef-496f-a813-6675c3fb1394): created successfully Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ed791f-7cb9-400d-8fc4-c049630338e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Flow 'volume_create_manager' (6b4d2295-f9ed-40a7-9748-eacdd05b2c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ff340ddc-b06b-4886-bf31-cfb82d3da83f tempest-VolumesCloneTest-14806241 None] Created volume successfully. Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-4583cd8d-abef-496f-a813-6675c3fb1394-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "cinder-4583cd8d-abef-496f-a813-6675c3fb1394-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:23 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 1073741824" returned: 0 in 0.760s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0eee53-7d14-4ed9-b7a9-66c18a368308]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:23 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 Aug 28 08:50:23 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:23 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 Aug 28 08:50:23 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:23 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1585333e-24b3-42fb-bb0a-0aed6d70346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc886b4-1973-4d0b-a572-200a3b614d58', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325f7e7-a26e-4d15-ba47-81145d46937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Volume volume-bdc886b4-1973-4d0b-a572-200a3b614d58 (bdc886b4-1973-4d0b-a572-200a3b614d58): created successfully Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325f7e7-a26e-4d15-ba47-81145d46937c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (42af394b-9179-4396-82a2-016ba887787b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f83b6010-20a1-494a-83a2-439cf6438821 tempest-VolumesListAdminTestJSON-1251157175 None] Created volume successfully. Aug 28 08:50:23 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394" returned: 0 in 0.420s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:23 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394 Aug 28 08:50:23 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:24 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4583cd8d-abef-496f-a813-6675c3fb1394" returned: 0 in 0.239s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-4583cd8d-abef-496f-a813-6675c3fb1394" released by "delete_volume" :: held 0.727s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Created reservations ['35cfc2d9-74c2-4b77-ac26-9b3f0c7be99b', 'e12c8812-2747-4ffe-84ce-a5bf52eff9e7', 'b9d2f418-bd62-461e-9523-ac75c18daa88', 'ca4f77a1-1534-4c2a-ba67-7a0566d8a0fc'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:24 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:24 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:24 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Deleted volume successfully. Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eadfc63c-ae0a-46d3-b1ba-79ab56f3a252 tempest-VolumesCloneTest-14806241 None] Lock "cinder-4583cd8d-abef-496f-a813-6675c3fb1394-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-2cc57159-ecfd-44d6-be34-6e098e117275-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "cinder-2cc57159-ecfd-44d6-be34-6e098e117275-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Acquiring lock "cinder-quobyte-2cc57159-ecfd-44d6-be34-6e098e117275" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-2cc57159-ecfd-44d6-be34-6e098e117275" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229c738-d043-43c8-b392-8a00d16fe634]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:25 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:25 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (45915c06-ed10-417f-bf3f-4c0872f41cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f5af6-888c-40b3-b8ae-f51168a2f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f5af6-888c-40b3-b8ae-f51168a2f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-608144730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78910ca-5b87-4c81-8f3c-6cd843cc253f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:25Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54feac-e41e-46fa-b059-26f30c01f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54feac-e41e-46fa-b059-26f30c01f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe56778-13f2-40dd-b725-db1f73a11bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe56778-13f2-40dd-b725-db1f73a11bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78910ca-5b87-4c81-8f3c-6cd843cc253f', 'volume_name': 'volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de074d9d-3e88-41b0-a467-d8ba7e665dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de074d9d-3e88-41b0-a467-d8ba7e665dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f53c5ef-15a4-43cb-b220-1dc65fa34582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:25 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Volume d78910ca-5b87-4c81-8f3c-6cd843cc253f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f', 'volume_size': 1} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-608144730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78910ca-5b87-4c81-8f3c-6cd843cc253f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284ecb740fef4d4e95be55ffd175b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:25Z,use_quota=True,user_id='37841a83e9b6445fb8981e1f3a5e6d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Creating volume d78910ca-5b87-4c81-8f3c-6cd843cc253f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:25 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:25 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f 1073741824 Aug 28 08:50:25 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:25 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.433s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:25 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275 Aug 28 08:50:25 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:25 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2cc57159-ecfd-44d6-be34-6e098e117275" returned: 0 in 0.333s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "cinder-quobyte-2cc57159-ecfd-44d6-be34-6e098e117275" released by "delete_volume" :: held 0.837s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:25 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f 1073741824" returned: 0 in 0.585s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Created reservations ['df3920e4-5518-43b6-a2ce-99d273704cda', 'e3eb1c0a-6483-45ba-ba26-074a5dea5b8d', 'ee4abffd-eeea-414a-bd96-08264a2d1413', '478898a3-7b17-4097-bee8-03853745d96f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:25 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f Aug 28 08:50:25 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:26 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:26 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:26 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f53c5ef-15a4-43cb-b220-1dc65fa34582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b978f60-15e5-4e2f-af8f-b36d2905e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:26 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Volume volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f (d78910ca-5b87-4c81-8f3c-6cd843cc253f): created successfully Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b978f60-15e5-4e2f-af8f-b36d2905e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Flow 'volume_create_manager' (45915c06-ed10-417f-bf3f-4c0872f41cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4e8dd52d-e67d-448d-a235-d5a12a62ac24 tempest-VolumesListAdminTestJSON-1251157175 None] Created volume successfully. Aug 28 08:50:26 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Deleted volume successfully. Aug 28 08:50:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3be6d77a-e81d-4bdf-8b17-076ccd715c12 tempest-VolumesCloneTest-14806241 None] Lock "cinder-2cc57159-ecfd-44d6-be34-6e098e117275-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Flow 'volume_create_manager' (982c1734-363e-4361-a538-d4414d9be512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c196fb72-9d56-45e5-b595-b090f925c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c196fb72-9d56-45e5-b595-b090f925c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3674cadb-2285-412e-8074-f5f7871e0305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc61a68a6224b2cbe2166817481dbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:29Z,use_quota=True,user_id='e55784c5682249dfb9ab4d464fc87357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f442829d-1924-4573-8003-12ad318bfaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f442829d-1924-4573-8003-12ad318bfaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bca4d3-a8c4-4b30-bceb-c0699f9ea9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bca4d3-a8c4-4b30-bceb-c0699f9ea9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3674cadb-2285-412e-8074-f5f7871e0305', 'volume_name': 'volume-3674cadb-2285-412e-8074-f5f7871e0305', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f78c9ef-18b3-48ff-94dd-31b54d42cf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f78c9ef-18b3-48ff-94dd-31b54d42cf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7eda48-69a2-4936-9bbc-d1249d3512d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Volume 3674cadb-2285-412e-8074-f5f7871e0305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3674cadb-2285-412e-8074-f5f7871e0305', 'volume_size': 1} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3674cadb-2285-412e-8074-f5f7871e0305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc61a68a6224b2cbe2166817481dbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:29Z,use_quota=True,user_id='e55784c5682249dfb9ab4d464fc87357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Creating volume 3674cadb-2285-412e-8074-f5f7871e0305 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:28 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:28 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 1073741824 Aug 28 08:50:28 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:29 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 1073741824" returned: 0 in 0.696s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:29 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 Aug 28 08:50:29 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:29 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305" returned: 0 in 0.385s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7eda48-69a2-4936-9bbc-d1249d3512d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3674cadb-2285-412e-8074-f5f7871e0305', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f06c1fc-003a-44de-a970-319317a8c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Volume volume-3674cadb-2285-412e-8074-f5f7871e0305 (3674cadb-2285-412e-8074-f5f7871e0305): created successfully Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f06c1fc-003a-44de-a970-319317a8c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Flow 'volume_create_manager' (982c1734-363e-4361-a538-d4414d9be512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8f2fc141-cfa4-4dce-b779-225f81b75a6c tempest-VolumesListAdminTestJSON-1769767695 None] Created volume successfully. Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Flow 'volume_create_manager' (e64f2767-d7c4-4fe2-83d4-49d9770a1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd1dc8-707e-4bb4-a015-320789d6ed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd1dc8-707e-4bb4-a015-320789d6ed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-660392353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8f6c07-5b45-4911-a543-e5515759032a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d9655328234591870a58e7f4cf300e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:30Z,use_quota=True,user_id='1483bb5578c144b4b9671b5c7a05446b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72ff25f-a3c8-4884-963f-68a87584805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72ff25f-a3c8-4884-963f-68a87584805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b109733-1665-47de-93f4-5270f0efa535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b109733-1665-47de-93f4-5270f0efa535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8f6c07-5b45-4911-a543-e5515759032a', 'volume_name': 'volume-3b8f6c07-5b45-4911-a543-e5515759032a', 'volume_size': 2}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43441d4-97cd-4d71-95c8-b1e1fceaeec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43441d4-97cd-4d71-95c8-b1e1fceaeec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd07cec2-0249-4c9d-8133-0dea4d6dd1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:30 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Volume 3b8f6c07-5b45-4911-a543-e5515759032a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8f6c07-5b45-4911-a543-e5515759032a', 'volume_size': 2} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-660392353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8f6c07-5b45-4911-a543-e5515759032a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d9655328234591870a58e7f4cf300e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:30Z,use_quota=True,user_id='1483bb5578c144b4b9671b5c7a05446b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Creating volume 3b8f6c07-5b45-4911-a543-e5515759032a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:30 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a 2147483648 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:30 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a 2147483648 Aug 28 08:50:30 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Acquiring lock "cinder-3674cadb-2285-412e-8074-f5f7871e0305-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "cinder-3674cadb-2285-412e-8074-f5f7871e0305-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Acquiring lock "cinder-quobyte-3674cadb-2285-412e-8074-f5f7871e0305" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "cinder-quobyte-3674cadb-2285-412e-8074-f5f7871e0305" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13034f1-cec9-4f7f-97b3-b9ae831adeb2]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-d78910ca-5b87-4c81-8f3c-6cd843cc253f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-d78910ca-5b87-4c81-8f3c-6cd843cc253f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-quobyte-d78910ca-5b87-4c81-8f3c-6cd843cc253f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-d78910ca-5b87-4c81-8f3c-6cd843cc253f" acquired by "delete_volume" :: waited 0.046s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:31 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 Aug 28 08:50:31 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5923a-d715-4459-9bf0-0cac97470ab0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:31 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a 2147483648" returned: 0 in 0.980s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:31 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f Aug 28 08:50:31 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:31 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a Aug 28 08:50:31 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:31 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305" returned: 0 in 0.752s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:31 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305 Aug 28 08:50:31 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:32 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f" returned: 0 in 0.583s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:32 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a" returned: 0 in 0.506s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:32 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f Aug 28 08:50:32 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd07cec2-0249-4c9d-8133-0dea4d6dd1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8f6c07-5b45-4911-a543-e5515759032a', 'volume_size': 2}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7115476c-4b33-4a3a-85df-88da102ef669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Volume volume-3b8f6c07-5b45-4911-a543-e5515759032a (3b8f6c07-5b45-4911-a543-e5515759032a): created successfully Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7115476c-4b33-4a3a-85df-88da102ef669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Flow 'volume_create_manager' (e64f2767-d7c4-4fe2-83d4-49d9770a1106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1afc5ab2-a7af-4b28-8259-d8039607b260 tempest-VolumesCloneNegativeTest-2126389677 None] Created volume successfully. Aug 28 08:50:32 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3674cadb-2285-412e-8074-f5f7871e0305" returned: 0 in 0.604s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "cinder-quobyte-3674cadb-2285-412e-8074-f5f7871e0305" released by "delete_volume" :: held 1.455s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:32 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d78910ca-5b87-4c81-8f3c-6cd843cc253f" returned: 0 in 0.523s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-d78910ca-5b87-4c81-8f3c-6cd843cc253f" released by "delete_volume" :: held 1.210s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Created reservations ['6b281e0e-3440-43a3-8654-39e6e9e042d9', '4b61f5fa-e32c-4c5f-b9cd-23be7b73266f', '384d9435-6976-4639-9a78-55c2fee024bc', 'f41992be-627f-4551-9d1d-b4dfd03a1dd7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Created reservations ['c8e04540-fda0-48ff-bd01-ffdfe46c070e', 'f013aef6-5619-4dfe-87ea-a8f6f741608b', '8e754c90-a25a-4283-8d86-78317d426b38', '23039198-4cb1-4e41-a6d4-2c1ba0d30afe'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:32 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:32 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Acquiring lock "cinder-3b8f6c07-5b45-4911-a543-e5515759032a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:33 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:33 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "cinder-3b8f6c07-5b45-4911-a543-e5515759032a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Acquiring lock "cinder-quobyte-3b8f6c07-5b45-4911-a543-e5515759032a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "cinder-quobyte-3b8f6c07-5b45-4911-a543-e5515759032a" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[60da0bfa-747d-4531-9959-8b33b9f7aa80]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:33 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.530s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Deleted volume successfully. Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb0dc5a-817e-4746-a3f8-97cd462daaf6 tempest-VolumesListAdminTestJSON-1769767695 None] Lock "cinder-3674cadb-2285-412e-8074-f5f7871e0305-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:33 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.502s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Deleted volume successfully. Aug 28 08:50:33 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a Aug 28 08:50:33 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c4bb84-ad33-4b14-b6a9-2c33b77c331d tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-d78910ca-5b87-4c81-8f3c-6cd843cc253f-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-bdc886b4-1973-4d0b-a572-200a3b614d58-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-bdc886b4-1973-4d0b-a572-200a3b614d58-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-quobyte-bdc886b4-1973-4d0b-a572-200a3b614d58" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-bdc886b4-1973-4d0b-a572-200a3b614d58" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab0477-5e7d-4373-8a40-4e0c263bc524]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:34 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a" returned: 0 in 0.812s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:34 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 Aug 28 08:50:34 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:34 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a Aug 28 08:50:34 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:34 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3b8f6c07-5b45-4911-a543-e5515759032a" returned: 0 in 0.307s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "cinder-quobyte-3b8f6c07-5b45-4911-a543-e5515759032a" released by "delete_volume" :: held 1.207s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:34 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58" returned: 0 in 0.472s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:34 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58 Aug 28 08:50:34 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Created reservations ['5728df6d-3490-40f2-aa88-791d2ee4f4cb', '9bc9b63a-7258-47e7-9191-b49eeefdae1c', '96d1cc90-9886-4394-8771-24a6daf6b8d1', 'd478d500-6311-471b-8b8e-b08cf9e8e4ee'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:34 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:34 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:34 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-bdc886b4-1973-4d0b-a572-200a3b614d58" returned: 0 in 0.327s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-bdc886b4-1973-4d0b-a572-200a3b614d58" released by "delete_volume" :: held 0.870s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Created reservations ['3fc1eb24-6eeb-4f63-b464-a741fd6e7574', '6bd02903-db57-499d-85cb-fa1f93534e01', '68cbf316-7ce4-4492-a295-9acb2f7527d9', '244f6cd5-6443-4f45-849e-b80085604871'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:34 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Deleted volume successfully. Aug 28 08:50:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-def694d7-ff2f-44bc-8cb1-615b4cfc61ff tempest-VolumesCloneNegativeTest-2126389677 None] Lock "cinder-3b8f6c07-5b45-4911-a543-e5515759032a-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:35 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:35 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-705c657c-abad-4ddd-9afd-68ce413fa420-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-705c657c-abad-4ddd-9afd-68ce413fa420-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "cinder-quobyte-705c657c-abad-4ddd-9afd-68ce413fa420" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-705c657c-abad-4ddd-9afd-68ce413fa420" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7503af-2dec-4987-ae88-5fca486bf28d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:35 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:35 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 Aug 28 08:50:35 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:35 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Deleted volume successfully. Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f8a62231-00b7-44e2-9b4b-88eb287b5516 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-bdc886b4-1973-4d0b-a572-200a3b614d58-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:35 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420" returned: 0 in 0.486s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:35 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420 Aug 28 08:50:35 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:36 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-705c657c-abad-4ddd-9afd-68ce413fa420" returned: 0 in 0.359s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-quobyte-705c657c-abad-4ddd-9afd-68ce413fa420" released by "delete_volume" :: held 0.889s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Created reservations ['7d9b87ca-bad9-4202-b5a5-2eb945c991be', 'da779ae4-5761-4b86-b734-0e2d45628f59', '5ecd878f-f9a9-421b-b3f9-31f0ac78f890', '9e115536-6e25-4b77-89b2-607479857ae2'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:36 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:36 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:36 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.411s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Deleted volume successfully. Aug 28 08:50:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9337f04-3bf8-4e02-b50d-27236437aa99 tempest-VolumesListAdminTestJSON-1251157175 None] Lock "cinder-705c657c-abad-4ddd-9afd-68ce413fa420-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:40 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:40 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Flow 'volume_create_manager' (646b512a-595f-4a09-add5-67d8f8fa978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91692376-b136-4032-bb6b-b27968cae3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91692376-b136-4032-bb6b-b27968cae3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-452034726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9285286d-09d2-4c9b-8c1b-15c02b4fdc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144a828f914c41129e22b5d352278855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:40Z,use_quota=True,user_id='768c7968edda4b11bb298181c67fd3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d44a05d-98f9-420a-95bf-dc06845fd213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d44a05d-98f9-420a-95bf-dc06845fd213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842f1b30-92f1-45c8-96df-97fa99b64f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842f1b30-92f1-45c8-96df-97fa99b64f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9285286d-09d2-4c9b-8c1b-15c02b4fdc60', 'volume_name': 'volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60', 'volume_size': 2}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076cadf-5e48-4391-8d31-845eb79c7ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076cadf-5e48-4391-8d31-845eb79c7ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007108a0-851c-4df4-8060-93ead05d36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Volume 9285286d-09d2-4c9b-8c1b-15c02b4fdc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60', 'volume_size': 2} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-452034726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9285286d-09d2-4c9b-8c1b-15c02b4fdc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144a828f914c41129e22b5d352278855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:40Z,use_quota=True,user_id='768c7968edda4b11bb298181c67fd3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Creating volume 9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:40 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 2147483648 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:40 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 2147483648 Aug 28 08:50:40 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:40 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.355s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:50:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:50:41 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 2147483648" returned: 0 in 0.596s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:41 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 Aug 28 08:50:41 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:41 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007108a0-851c-4df4-8060-93ead05d36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60', 'volume_size': 2}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2910312-f449-4d66-8b23-9ef11be7a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:41 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Volume volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 (9285286d-09d2-4c9b-8c1b-15c02b4fdc60): created successfully Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2910312-f449-4d66-8b23-9ef11be7a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Flow 'volume_create_manager' (646b512a-595f-4a09-add5-67d8f8fa978c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-038edbb0-89b9-41cb-9df5-3be8762e143a tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Created volume successfully. Aug 28 08:50:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Creating offline snapshot d65e966d-f1e5-42b5-baf3-14dbb135c48f of volume 9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:50:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d467c48-5d1a-4cf1-89f3-4e0fa8d5423a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:43 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 Aug 28 08:50:43 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:43 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" returned: 0 in 0.534s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f 2G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:43 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f 2G Aug 28 08:50:43 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:43 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f 2G" returned: 0 in 0.555s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:43 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f Aug 28 08:50:43 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:44 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f" returned: 0 in 0.446s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:44 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f is being set with open permissions: ugo+rw Aug 28 08:50:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:44 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f Aug 28 08:50:44 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:44 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f" returned: 0 in 0.326s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:44 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info Aug 28 08:50:44 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:45 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:45 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info is being set with open permissions: ugo+rw Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:45 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info Aug 28 08:50:45 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:45 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.info" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-856dd362-e13b-4429-9c23-ceecb356edbe tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Create snapshot completed successfully Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Flow 'volume_create_manager' (eceb7b6d-9efa-48d4-9b1d-8432a7d68422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd99391-e216-4561-9e09-81454cc3d129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd99391-e216-4561-9e09-81454cc3d129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1207935280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652459cb-a8dc-48cf-a2da-699c70a278a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d130936917504dbbba6b0b064218d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:46Z,use_quota=True,user_id='0e2e677abf814f28895921b5525f0e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d97465-670e-46b1-aed8-d1fccea2a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d97465-670e-46b1-aed8-d1fccea2a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11893ee1-9c37-4bc2-b993-bff4fad00b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11893ee1-9c37-4bc2-b993-bff4fad00b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652459cb-a8dc-48cf-a2da-699c70a278a6', 'volume_name': 'volume-652459cb-a8dc-48cf-a2da-699c70a278a6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f09f7-a31e-4fb1-a8ea-13f3de9c513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f09f7-a31e-4fb1-a8ea-13f3de9c513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e2dbbe-d876-42b1-ac10-23a16241ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Volume 652459cb-a8dc-48cf-a2da-699c70a278a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652459cb-a8dc-48cf-a2da-699c70a278a6', 'volume_size': 1} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1207935280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652459cb-a8dc-48cf-a2da-699c70a278a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d130936917504dbbba6b0b064218d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:50:46Z,use_quota=True,user_id='0e2e677abf814f28895921b5525f0e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Creating volume 652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:50:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:50:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:45 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 1073741824 Aug 28 08:50:45 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "cinder-d65e966d-f1e5-42b5-baf3-14dbb135c48f-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-d65e966d-f1e5-42b5-baf3-14dbb135c48f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "cinder-quobyte-d65e966d-f1e5-42b5-baf3-14dbb135c48f" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-d65e966d-f1e5-42b5-baf3-14dbb135c48f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Deleting offline snapshot d65e966d-f1e5-42b5-baf3-14dbb135c48f of volume 9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] snapshot_file for this snap is: volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[25176449-a241-4566-848a-f015778a376e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:46 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 1073741824" returned: 0 in 0.584s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:46 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 Aug 28 08:50:46 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:46 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f Aug 28 08:50:46 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:46 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e2dbbe-d876-42b1-ac10-23a16241ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652459cb-a8dc-48cf-a2da-699c70a278a6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c38aab-5876-4633-ad4f-2ce4fa2c2dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:50:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Volume volume-652459cb-a8dc-48cf-a2da-699c70a278a6 (652459cb-a8dc-48cf-a2da-699c70a278a6): created successfully Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c38aab-5876-4633-ad4f-2ce4fa2c2dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Flow 'volume_create_manager' (eceb7b6d-9efa-48d4-9b1d-8432a7d68422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:50:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3c4c7c95-b303-4a88-8aae-9420c635c9c3 tempest-SnapshotMetadataTestJSON-1509010166 None] Created volume successfully. Aug 28 08:50:46 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f" returned: 0 in 0.547s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[96377164-57e5-463f-b555-60d8f1c27a51]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:46 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 Aug 28 08:50:46 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:47 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" returned: 0 in 0.541s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:47 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f Aug 28 08:50:47 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:47 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f" returned: 0 in 0.575s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:47 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f Aug 28 08:50:47 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Creating offline snapshot 083d26ba-fdf3-4692-8496-d89467ebf56c of volume 652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850b2de-fbf3-4a03-95b9-31ae80e612f4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:48 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 Aug 28 08:50:48 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:48 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60.d65e966d-f1e5-42b5-baf3-14dbb135c48f" returned: 0 in 0.364s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-d65e966d-f1e5-42b5-baf3-14dbb135c48f" released by "_delete_snapshot" :: held 2.229s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" released by "delete_snapshot" :: held 2.273s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Created reservations ['18120274-2e3a-43b9-9186-83092052b34e', 'c3cbaf68-2dd2-4111-bde5-7e1d66344087', '91a84368-4ef1-424e-bad6-5eac7af9fb38', 'dbbe3d3a-b128-4c71-a416-3c01fc295af2'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Delete snapshot completed successfully. Aug 28 08:50:48 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6" returned: 0 in 0.599s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a5e80f03-3df4-42cc-8ded-0233672835c7 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-d65e966d-f1e5-42b5-baf3-14dbb135c48f-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:48 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c 1G Aug 28 08:50:48 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e8019430-1c5e-4c90-a1da-88f345bfcea8 req-c313ff0b-e29b-4245-bb20-bc66ee7005fd tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:49 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c 1G" returned: 0 in 0.545s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652459cb-a8dc-48cf-a2da-699c70a278a6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:49 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652459cb-a8dc-48cf-a2da-699c70a278a6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c Aug 28 08:50:49 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "cinder-9285286d-09d2-4c9b-8c1b-15c02b4fdc60-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-9285286d-09d2-4c9b-8c1b-15c02b4fdc60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:49 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652459cb-a8dc-48cf-a2da-699c70a278a6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c" returned: 0 in 0.382s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:49 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c is being set with open permissions: ugo+rw Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed1393-7c59-4bcf-a566-5b86153a77cb]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:49 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c Aug 28 08:50:49 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:49 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 Aug 28 08:50:49 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:49 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:49 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info Aug 28 08:50:49 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:50 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" returned: 0 in 0.441s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:50 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60 Aug 28 08:50:50 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:50 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info" returned: 0 in 0.307s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:50 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info is being set with open permissions: ugo+rw Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:50 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info Aug 28 08:50:50 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:50 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" returned: 0 in 0.263s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-quobyte-9285286d-09d2-4c9b-8c1b-15c02b4fdc60" released by "delete_volume" :: held 0.804s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Created reservations ['dab3d2ce-3eba-49bd-a3bd-e3423117b1ac', 'f5e56321-0b06-44e8-8045-952c3f6fa3da', '4df63594-0546-41a1-b89d-ec1f7b78d7ed', '83b71def-15eb-4a2a-95bc-d9a2b8984253'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:50 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.info" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:50 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:50 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e8019430-1c5e-4c90-a1da-88f345bfcea8 req-c313ff0b-e29b-4245-bb20-bc66ee7005fd tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.383s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e8019430-1c5e-4c90-a1da-88f345bfcea8 req-c313ff0b-e29b-4245-bb20-bc66ee7005fd tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f35196f2-f564-4f0c-a997-6679e20457f9 tempest-SnapshotMetadataTestJSON-1509010166 None] Create snapshot completed successfully Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-e8019430-1c5e-4c90-a1da-88f345bfcea8 req-c313ff0b-e29b-4245-bb20-bc66ee7005fd tempest-TestServerVolumeAttachmentScenario-1150905160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a43e2d0-de8c-4b17-b376-72c44a8d95d3', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:50:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-e8019430-1c5e-4c90-a1da-88f345bfcea8 req-c313ff0b-e29b-4245-bb20-bc66ee7005fd tempest-TestServerVolumeAttachmentScenario-1150905160 None] attachment_update completed successfully. Aug 28 08:50:50 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.456s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Deleted volume successfully. Aug 28 08:50:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e883435c-df91-4b63-bd8b-dc899a859505 tempest-VolumesSnapshotNegativeTestJSON-1044763430 None] Lock "cinder-9285286d-09d2-4c9b-8c1b-15c02b4fdc60-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "cinder-083d26ba-fdf3-4692-8496-d89467ebf56c-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-083d26ba-fdf3-4692-8496-d89467ebf56c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "cinder-quobyte-083d26ba-fdf3-4692-8496-d89467ebf56c" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-083d26ba-fdf3-4692-8496-d89467ebf56c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Deleting offline snapshot 083d26ba-fdf3-4692-8496-d89467ebf56c of volume 652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] snapshot_file for this snap is: volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b05cc-5a01-45c6-91f6-1f7080c9de05]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:52 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c Aug 28 08:50:52 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:52 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c" returned: 0 in 0.552s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652459cb-a8dc-48cf-a2da-699c70a278a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b3ace-ab05-4330-8119-2d946fe0ac58]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:53 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 Aug 28 08:50:53 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:53 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6" returned: 0 in 0.484s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:53 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c Aug 28 08:50:53 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:53 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c" returned: 0 in 0.430s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:53 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c Aug 28 08:50:53 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:54 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6.083d26ba-fdf3-4692-8496-d89467ebf56c" returned: 0 in 0.330s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-083d26ba-fdf3-4692-8496-d89467ebf56c" released by "_delete_snapshot" :: held 2.019s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" released by "delete_snapshot" :: held 2.060s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:54 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Created reservations ['3934c0ff-a44b-4d7c-99b4-b36e5712bf64', 'ee2cc5a9-6243-418b-8b79-19b419f68715', '7762c68b-2be2-4bd3-9f57-9f9ab9aeb463', '93eaca58-c917-4d00-9929-3620bdd69f0e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Delete snapshot completed successfully. Aug 28 08:50:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-19bc0116-757b-4145-9a78-67eec1864200 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-083d26ba-fdf3-4692-8496-d89467ebf56c-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "cinder-652459cb-a8dc-48cf-a2da-699c70a278a6-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-652459cb-a8dc-48cf-a2da-699c70a278a6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:50:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:50:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89740dd-9df0-4c78-ad37-c95ec4d1a1b1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:50:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:56 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 Aug 28 08:50:56 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:56 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6" returned: 0 in 0.629s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:56 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6 Aug 28 08:50:56 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:57 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-652459cb-a8dc-48cf-a2da-699c70a278a6" returned: 0 in 0.416s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-quobyte-652459cb-a8dc-48cf-a2da-699c70a278a6" released by "delete_volume" :: held 1.153s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Created reservations ['3d1a14fa-d7c4-43e2-9de8-2221077055ec', 'b4127640-4122-4e8a-9e5d-110edb88086d', '0b033c21-da4a-4efc-938a-45cf96b4da3f', 'f274e232-2124-47b2-b9ae-781d56bf81a2'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:50:57 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:50:57 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-df5c52b9-a155-4941-9cd8-7fbb899a4b5c req-75a6641c-e0bc-46d9-9bdf-288710996c30 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-df5c52b9-a155-4941-9cd8-7fbb899a4b5c req-75a6641c-e0bc-46d9-9bdf-288710996c30 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-df5c52b9-a155-4941-9cd8-7fbb899a4b5c req-75a6641c-e0bc-46d9-9bdf-288710996c30 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-df5c52b9-a155-4941-9cd8-7fbb899a4b5c req-75a6641c-e0bc-46d9-9bdf-288710996c30 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52be2636-3743-4a4a-93d6-cecea247b8b3', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:50:57 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:50:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Deleted volume successfully. Aug 28 08:50:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aab5cb6d-0d90-4bab-ab4a-5c81d8b90ea9 tempest-SnapshotMetadataTestJSON-1509010166 None] Lock "cinder-652459cb-a8dc-48cf-a2da-699c70a278a6-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:50:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-df5c52b9-a155-4941-9cd8-7fbb899a4b5c req-75a6641c-e0bc-46d9-9bdf-288710996c30 tempest-TestServerVolumeAttachmentScenario-1150905160 None] attachment_update completed successfully. Aug 28 08:51:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-9e8e4361-5082-4471-89ae-7d41e817c7bb req-ae815f0a-24a3-4666-9b01-526908bb430f tempest-TestServerVolumeAttachmentScenario-1150905160 None] Terminate volume connection completed successfully. Aug 28 08:51:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-9e8e4361-5082-4471-89ae-7d41e817c7bb req-ae815f0a-24a3-4666-9b01-526908bb430f tempest-TestServerVolumeAttachmentScenario-1150905160 None] Deleting attachment 52be2636-3743-4a4a-93d6-cecea247b8b3. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:51:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-5cd08011-f7b9-472f-a715-c939a7c2f892 req-c112e1d1-e697-4fb1-bec4-9c2150fcd507 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Terminate volume connection completed successfully. Aug 28 08:51:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-5cd08011-f7b9-472f-a715-c939a7c2f892 req-c112e1d1-e697-4fb1-bec4-9c2150fcd507 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Deleting attachment 5a43e2d0-de8c-4b17-b376-72c44a8d95d3. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Flow 'volume_create_manager' (5866af8c-2197-4fb3-b55f-469e9edbabad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3261c53-529f-4cf9-b92b-3ec526b01d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3261c53-529f-4cf9-b92b-3ec526b01d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1091723526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87a5308-17bb-495a-8ea9-89af419f5113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5953c71bd47968228bd2bbeb3a3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:06Z,use_quota=True,user_id='0bfc219338f54b3897b570c310b5e4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f59768-22a1-4d9d-9c7a-023dfbb43782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f59768-22a1-4d9d-9c7a-023dfbb43782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0283b8-caa0-4b2b-9238-fc64cb6fb195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0283b8-caa0-4b2b-9238-fc64cb6fb195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87a5308-17bb-495a-8ea9-89af419f5113', 'volume_name': 'volume-f87a5308-17bb-495a-8ea9-89af419f5113', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd6a456-77b4-4b6e-a144-24d29c63be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd6a456-77b4-4b6e-a144-24d29c63be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14928f8b-4a40-4175-884b-83252b2dcbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Volume f87a5308-17bb-495a-8ea9-89af419f5113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87a5308-17bb-495a-8ea9-89af419f5113', 'volume_size': 1} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1091723526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87a5308-17bb-495a-8ea9-89af419f5113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5953c71bd47968228bd2bbeb3a3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:06Z,use_quota=True,user_id='0bfc219338f54b3897b570c310b5e4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Creating volume f87a5308-17bb-495a-8ea9-89af419f5113 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:51:06 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:51:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:06 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 1073741824 Aug 28 08:51:06 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:07 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 1073741824" returned: 0 in 0.766s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:07 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 Aug 28 08:51:07 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:08 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14928f8b-4a40-4175-884b-83252b2dcbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87a5308-17bb-495a-8ea9-89af419f5113', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c10f66a-86fb-44f9-991c-995622f351a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:08 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Volume volume-f87a5308-17bb-495a-8ea9-89af419f5113 (f87a5308-17bb-495a-8ea9-89af419f5113): created successfully Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c10f66a-86fb-44f9-991c-995622f351a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Flow 'volume_create_manager' (5866af8c-2197-4fb3-b55f-469e9edbabad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-dee8c8ef-71ae-4a23-a9c5-cea7ac4a4a6b tempest-VolumesTransfersTest-484533609 None] Created volume successfully. Aug 28 08:51:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-40914000-6e7f-4fe6-8e90-2dff10270add tempest-VolumesTransfersTest-403584944 None] Transfer volume completed successfully. Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "cinder-f87a5308-17bb-495a-8ea9-89af419f5113-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-f87a5308-17bb-495a-8ea9-89af419f5113-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "cinder-quobyte-f87a5308-17bb-495a-8ea9-89af419f5113" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-quobyte-f87a5308-17bb-495a-8ea9-89af419f5113" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6811dda2-836d-4fe2-9463-182ed8b261ee]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:11 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 Aug 28 08:51:11 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:11 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113" returned: 0 in 0.483s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:11 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113 Aug 28 08:51:11 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:11 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f87a5308-17bb-495a-8ea9-89af419f5113" returned: 0 in 0.401s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-quobyte-f87a5308-17bb-495a-8ea9-89af419f5113" released by "delete_volume" :: held 0.945s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Created reservations ['1bf55ea1-79e8-449a-80f4-5bffb0103979', '483d6500-c8c5-4765-95c8-346314fe7f56', 'df091d89-cd18-4f84-aa70-1aba4c6adc2f', 'bf20b74a-68e3-4271-bd9a-76915f0c8580'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:51:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "cinder-94238d46-4f6a-48f3-aa43-cfafbb6169a2-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-94238d46-4f6a-48f3-aa43-cfafbb6169a2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "cinder-quobyte-94238d46-4f6a-48f3-aa43-cfafbb6169a2" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-quobyte-94238d46-4f6a-48f3-aa43-cfafbb6169a2" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:12 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:12 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a745748-4462-4c7a-b01c-3350cca3d19f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:12 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 Aug 28 08:51:12 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:12 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.355s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Deleted volume successfully. Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7589a9ad-91e3-4a4a-a6ee-cd124a9ff9b7 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-f87a5308-17bb-495a-8ea9-89af419f5113-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:12 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2" returned: 0 in 0.547s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:12 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2 Aug 28 08:51:12 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:13 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-94238d46-4f6a-48f3-aa43-cfafbb6169a2" returned: 0 in 0.318s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-quobyte-94238d46-4f6a-48f3-aa43-cfafbb6169a2" released by "delete_volume" :: held 0.965s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Created reservations ['b88cf45e-39a4-406b-8883-ab06be109f4f', 'f6581329-2a8e-4505-ad98-4996a4e84cb7', '64fed2cb-c035-4cfe-a814-39a2ffc32ee1', '19e496ac-db83-448c-9cdf-69bfc1d5cd2a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:13 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:13 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:13 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.432s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Deleted volume successfully. Aug 28 08:51:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60fafb6b-bf2c-4057-9df4-7b992f99de06 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-94238d46-4f6a-48f3-aa43-cfafbb6169a2-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Flow 'volume_create_manager' (ef2771bf-a041-4a13-a314-eb9a781e33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9125bc-f216-4539-a7d5-186a790d1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9125bc-f216-4539-a7d5-186a790d1a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-541378962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f100b1-e9f9-4944-9009-bad8053abec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5953c71bd47968228bd2bbeb3a3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:14Z,use_quota=True,user_id='0bfc219338f54b3897b570c310b5e4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535a1a79-bb2e-4eea-a51d-cdca51a8030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535a1a79-bb2e-4eea-a51d-cdca51a8030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8afd9a-6304-4443-ac0a-0119da3b1361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8afd9a-6304-4443-ac0a-0119da3b1361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f100b1-e9f9-4944-9009-bad8053abec6', 'volume_name': 'volume-41f100b1-e9f9-4944-9009-bad8053abec6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ff01d0-8cc9-4feb-9a75-66385a1313b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ff01d0-8cc9-4feb-9a75-66385a1313b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba9fac-c917-40e3-8d64-d8669e709b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Volume 41f100b1-e9f9-4944-9009-bad8053abec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f100b1-e9f9-4944-9009-bad8053abec6', 'volume_size': 1} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-541378962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f100b1-e9f9-4944-9009-bad8053abec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5953c71bd47968228bd2bbeb3a3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:14Z,use_quota=True,user_id='0bfc219338f54b3897b570c310b5e4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Creating volume 41f100b1-e9f9-4944-9009-bad8053abec6 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:51:14 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:14 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 1073741824 Aug 28 08:51:14 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "cinder-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "cinder-quobyte-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-quobyte-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627110a-0a22-4336-ac27-62f437b19b6f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:14 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 Aug 28 08:51:14 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:14 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 1073741824" returned: 0 in 0.625s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:15 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 Aug 28 08:51:15 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:15 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" returned: 0 in 0.582s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:15 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3 Aug 28 08:51:15 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:15 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6" returned: 0 in 0.464s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba9fac-c917-40e3-8d64-d8669e709b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f100b1-e9f9-4944-9009-bad8053abec6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e679b-b7a3-4a3b-8fe5-75785bec58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:15 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Volume volume-41f100b1-e9f9-4944-9009-bad8053abec6 (41f100b1-e9f9-4944-9009-bad8053abec6): created successfully Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e679b-b7a3-4a3b-8fe5-75785bec58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Flow 'volume_create_manager' (ef2771bf-a041-4a13-a314-eb9a781e33a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2e1e12f7-85f7-40c4-a774-6638c256a03d tempest-VolumesTransfersTest-484533609 None] Created volume successfully. Aug 28 08:51:15 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" returned: 0 in 0.481s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-quobyte-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3" released by "delete_volume" :: held 1.120s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Created reservations ['f3fef3e3-77c8-4c58-b51c-7cd4c8d85d8b', '9c626c92-a8c8-43c7-bd38-b537452e4851', 'a683678a-1ca1-40bb-97ba-cdbcde3bd91d', '8db4dbbf-d3b3-4420-aa7a-d5122629b5da'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:15 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:15 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:16 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Deleted volume successfully. Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-86e6d710-8a63-4c5b-ba9f-4be738a61d79 tempest-TestServerVolumeAttachmentScenario-1150905160 None] Lock "cinder-3c21dd6e-2e4c-44e0-900d-613e4a1f1de3-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "cinder-41f100b1-e9f9-4944-9009-bad8053abec6-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-41f100b1-e9f9-4944-9009-bad8053abec6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "cinder-quobyte-41f100b1-e9f9-4944-9009-bad8053abec6" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-quobyte-41f100b1-e9f9-4944-9009-bad8053abec6" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5f15d-4e89-44cc-a9b1-56be065c5ac2]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:17 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 Aug 28 08:51:17 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:17 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:17 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6 Aug 28 08:51:17 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:17 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41f100b1-e9f9-4944-9009-bad8053abec6" returned: 0 in 0.478s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-quobyte-41f100b1-e9f9-4944-9009-bad8053abec6" released by "delete_volume" :: held 1.044s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Created reservations ['a8d4906c-5649-45a6-be9b-e27b8ecfc188', 'dc50cebe-f0b8-49af-912c-9ed0ee640b2b', 'a0bc373d-a3d6-4531-9e4b-0305867e87e2', '06ea3b9d-9113-471c-92c9-6d2c4eab54ef'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:18 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:18 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:18 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.329s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Deleted volume successfully. Aug 28 08:51:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b36bcd01-7478-409a-9595-3d00cdb566e9 tempest-VolumesTransfersTest-791810238 None] Lock "cinder-41f100b1-e9f9-4944-9009-bad8053abec6-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=159,cinder:SELECT=113,cinder:DELETE=14,cinder:INSERT=37 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:51:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=138,cinder:SELECT=117,cinder:INSERT=34,cinder:DELETE=10 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Flow 'volume_create_manager' (c25a40b8-f34e-405b-8676-f535ad6e54e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ef39ae-b045-43d7-8d39-d2247074f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ef39ae-b045-43d7-8d39-d2247074f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2075476986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4864f5-3046-4740-8cdf-009199a7c326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12249e572514a73b6575fa34d8704a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:35Z,use_quota=True,user_id='939909c032c04c69a22a625f022b98b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4c6f57-8744-4985-b87b-65502ec35bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4c6f57-8744-4985-b87b-65502ec35bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461214c9-e7bf-4fb1-9b83-b7155ee705e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Flow 'volume_create_manager' (11a1e484-d802-4fcf-a8e8-664cea430c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fe4fba-0572-4bec-935c-6e182a71a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fe4fba-0572-4bec-935c-6e182a71a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1684650513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09dc3be-9f96-4b3e-912c-66cbf35fa335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f52386ebbc4029b56f7ba8d4fb58c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:35Z,use_quota=True,user_id='c4286a01b3534341a31fa0a2ddc8aa0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abedfb86-edd8-4344-8889-6a9eec3d3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abedfb86-edd8-4344-8889-6a9eec3d3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97298dcb-e378-4634-a696-85611a6360c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97298dcb-e378-4634-a696-85611a6360c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09dc3be-9f96-4b3e-912c-66cbf35fa335', 'volume_name': 'volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb8d23e-4968-44c8-a23e-e86002e0ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb8d23e-4968-44c8-a23e-e86002e0ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c279a3d2-ec55-4420-b1b8-ff441a81f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:34 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Volume f09dc3be-9f96-4b3e-912c-66cbf35fa335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335', 'volume_size': 1} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1684650513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09dc3be-9f96-4b3e-912c-66cbf35fa335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f52386ebbc4029b56f7ba8d4fb58c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:35Z,use_quota=True,user_id='c4286a01b3534341a31fa0a2ddc8aa0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Creating volume f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:51:34 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:51:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:35 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 1073741824 Aug 28 08:51:35 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461214c9-e7bf-4fb1-9b83-b7155ee705e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad4864f5-3046-4740-8cdf-009199a7c326', 'volume_name': 'volume-ad4864f5-3046-4740-8cdf-009199a7c326', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712605cd-3d48-4e6b-97d5-7139fbff6465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712605cd-3d48-4e6b-97d5-7139fbff6465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf1cefa-fa8d-4e35-9a61-3946f8ffd20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:35 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Volume ad4864f5-3046-4740-8cdf-009199a7c326: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad4864f5-3046-4740-8cdf-009199a7c326', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 08:51:35 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Trying to clone ad4864f5-3046-4740-8cdf-009199a7c326 from image f08659ba-d34f-40d3-9342-92af7297d5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 08:51:36 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Image download 20.69 MB at 20.69 MB/s Aug 28 08:51:36 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 1073741824" returned: 0 in 1.123s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7884b0-cb1d-4de0-be86-e75a885412e0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:36 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:51:36 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:36 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD Aug 28 08:51:36 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:36 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 is fetched for user 939909c032c04c69a22a625f022b98b1. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 08:51:36 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.594s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa577d-9b66-4503-923b-dfcc71c52ea5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c279a3d2-ec55-4420-b1b8-ff441a81f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6425f6fc-a5e9-4756-994d-819a162190bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Volume volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 (f09dc3be-9f96-4b3e-912c-66cbf35fa335): created successfully Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6425f6fc-a5e9-4756-994d-819a162190bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Flow 'volume_create_manager' (11a1e484-d802-4fcf-a8e8-664cea430c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1a6e171d-eef9-4a3e-bcb6-44ad8c5846a3 tempest-TestStampPattern-669368986 None] Created volume successfully. Aug 28 08:51:36 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD Aug 28 08:51:36 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:37 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD" returned: 0 in 0.625s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2075476986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4864f5-3046-4740-8cdf-009199a7c326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12249e572514a73b6575fa34d8704a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:35Z,use_quota=True,user_id='939909c032c04c69a22a625f022b98b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Creating volume ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:51:37 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:51:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:37 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1073741824 Aug 28 08:51:37 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:38 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1073741824" returned: 0 in 0.704s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:38 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 Aug 28 08:51:38 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:38 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326" returned: 0 in 0.426s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Attempting download of f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume ad4864f5-3046-4740-8cdf-009199a7c326. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb929aa4-98fb-47c4-868c-a6f700cc2c04]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:38 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny Aug 28 08:51:38 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:39 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny" returned: 0 in 0.592s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:39 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny Aug 28 08:51:39 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:40 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny" returned: 1 in 0.739s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_zu0c_cny' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dbc47e-7998-40d7-93da-3bc131cd758d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:40 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD Aug 28 08:51:40 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:40 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:40 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:40 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD" returned: 0 in 0.615s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] f08659ba-d34f-40d3-9342-92af7297d5d7 was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:40 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 Aug 28 08:51:40 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:40 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.540s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:51:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:51:43 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326" returned: 0 in 2.813s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:43 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_gbessnppdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:51:43 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Converted 112.00 MB image at 39.78 MB/s Aug 28 08:51:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:43 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1G Aug 28 08:51:43 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:44 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 1G" returned: 0 in 0.726s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Downloaded image f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume ad4864f5-3046-4740-8cdf-009199a7c326 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 for user 939909c032c04c69a22a625f022b98b1 is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Marking volume ad4864f5-3046-4740-8cdf-009199a7c326 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Copying metadata from image f08659ba-d34f-40d3-9342-92af7297d5d7 to ad4864f5-3046-4740-8cdf-009199a7c326. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Creating volume glance metadata for volume ad4864f5-3046-4740-8cdf-009199a7c326 backed by image f08659ba-d34f-40d3-9342-92af7297d5d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf1cefa-fa8d-4e35-9a61-3946f8ffd20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4864f5-3046-4740-8cdf-009199a7c326', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f6009-97a3-4a09-83e3-d8ac988cc909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Volume volume-ad4864f5-3046-4740-8cdf-009199a7c326 (ad4864f5-3046-4740-8cdf-009199a7c326): created successfully Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f6009-97a3-4a09-83e3-d8ac988cc909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Flow 'volume_create_manager' (c25a40b8-f34e-405b-8676-f535ad6e54e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2465d3fc-799b-4847-b060-02c62e4d653c tempest-VolumesExtendTest-1009937486 None] Created volume successfully. Aug 28 08:51:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:46 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d3c42-1506-40ef-a4b8-1cde4690f7b0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:46 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 Aug 28 08:51:46 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:47 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326" returned: 0 in 0.782s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 2G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 2G" returned: 0 in 0.177s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-da6a2a59-fbf4-45fb-bc77-46c3351bc30b tempest-VolumesExtendTest-1009937486 None] Extend volume completed successfully. Aug 28 08:51:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-ad4864f5-3046-4740-8cdf-009199a7c326-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-ad4864f5-3046-4740-8cdf-009199a7c326-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-quobyte-ad4864f5-3046-4740-8cdf-009199a7c326" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-ad4864f5-3046-4740-8cdf-009199a7c326" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4243bfd-5407-445c-9e96-58eba4ec465a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:48 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 Aug 28 08:51:48 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:48 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326" returned: 0 in 0.616s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:48 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326 Aug 28 08:51:48 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:49 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad4864f5-3046-4740-8cdf-009199a7c326" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-ad4864f5-3046-4740-8cdf-009199a7c326" released by "delete_volume" :: held 1.127s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Created reservations ['535c450b-bfc5-4130-b8a3-a313fa647b29', 'c0a51dad-f2ae-454d-9f7b-61a28e58ad71', '0d71b290-caf7-4fe2-abf8-86cb902165f8', '84509366-17b1-47b1-a130-3bff5dde46b2'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:49 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:51:49 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:50 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.640s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:51:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Deleted volume successfully. Aug 28 08:51:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-be18a71b-200a-4a96-99d3-94b3cd3c682f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-ad4864f5-3046-4740-8cdf-009199a7c326-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Flow 'volume_create_manager' (2c66f781-0b97-4054-840e-770e70c9dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671fc28f-4882-4694-9f0a-802a09007016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671fc28f-4882-4694-9f0a-802a09007016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2098180697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2a8c1-249a-4378-b6fd-821b5225a4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12249e572514a73b6575fa34d8704a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:52Z,use_quota=True,user_id='939909c032c04c69a22a625f022b98b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9701-e391-4339-9697-09291ae6a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9701-e391-4339-9697-09291ae6a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a56d6ff-1735-4f02-b9c8-e4b15c9e26a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a56d6ff-1735-4f02-b9c8-e4b15c9e26a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad2a8c1-249a-4378-b6fd-821b5225a4d9', 'volume_name': 'volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf61402a-3caf-4e73-a803-8c77caad42c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf61402a-3caf-4e73-a803-8c77caad42c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ddecc-3f7a-476a-9ce3-6aa43f446ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:52 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Volume aad2a8c1-249a-4378-b6fd-821b5225a4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9', 'volume_size': 1} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2098180697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2a8c1-249a-4378-b6fd-821b5225a4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12249e572514a73b6575fa34d8704a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:51:52Z,use_quota=True,user_id='939909c032c04c69a22a625f022b98b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Creating volume aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:51:52 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:51:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:52 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 1073741824 Aug 28 08:51:52 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:53 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 1073741824" returned: 0 in 1.083s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:53 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:51:53 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:54 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.741s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ddecc-3f7a-476a-9ce3-6aa43f446ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd889ba-7a7f-4862-b9c8-95995c0eafaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:51:54 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Volume volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 (aad2a8c1-249a-4378-b6fd-821b5225a4d9): created successfully Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd889ba-7a7f-4862-b9c8-95995c0eafaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:51:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Flow 'volume_create_manager' (2c66f781-0b97-4054-840e-770e70c9dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:51:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-af6410d4-02f8-4ee1-aee0-70f2d16cdadd tempest-VolumesExtendTest-1009937486 None] Created volume successfully. Aug 28 08:51:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:51:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:51:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Creating offline snapshot e8265065-08b7-4785-98a1-5316d478b2f2 of volume aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:51:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[892dc975-0cb7-4a3c-8db7-59766812f85e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:51:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:56 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:51:56 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:56 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.812s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:56 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 1G Aug 28 08:51:56 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:57 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 1G" returned: 0 in 0.670s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:57 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 Aug 28 08:51:57 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:57 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:57 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 is being set with open permissions: ugo+rw Aug 28 08:51:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:57 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 Aug 28 08:51:57 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:58 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2" returned: 0 in 0.697s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:58 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info Aug 28 08:51:58 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:59 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info" returned: 0 in 0.626s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:59 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info is being set with open permissions: ugo+rw Aug 28 08:51:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:51:59 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info Aug 28 08:51:59 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:51:59 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Aug 28 08:51:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.info" returned: 0 in 0.441s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:51:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:51:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-747300e4-b799-4911-9f7a-049b6c604e17 tempest-VolumesExtendTest-1009937486 None] Create snapshot completed successfully Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4309102-2602-4fc0-bf87-ea10d18a0221]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:00 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:52:00 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:00 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.591s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 2G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 2G" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.902s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fa3967e3-5a30-4735-88f9-a6480458b97f tempest-VolumesExtendTest-1009937486 None] Extend volume completed successfully. Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-e8265065-08b7-4785-98a1-5316d478b2f2-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-e8265065-08b7-4785-98a1-5316d478b2f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-quobyte-e8265065-08b7-4785-98a1-5316d478b2f2" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-e8265065-08b7-4785-98a1-5316d478b2f2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Deleting offline snapshot e8265065-08b7-4785-98a1-5316d478b2f2 of volume aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] snapshot_file for this snap is: volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4dcc7-3ccc-4bcc-8eb6-6c119d9df986]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:02 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 Aug 28 08:52:02 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:02 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2" returned: 0 in 0.731s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:52:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0a185-9a43-4a84-af25-bb28b91c0635]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:02 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:52:02 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:03 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.525s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:03 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 Aug 28 08:52:03 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:03 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2" returned: 0 in 0.545s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:03 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2 Aug 28 08:52:03 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:04 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9.e8265065-08b7-4785-98a1-5316d478b2f2" returned: 0 in 0.316s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-e8265065-08b7-4785-98a1-5316d478b2f2" released by "_delete_snapshot" :: held 2.305s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" released by "delete_snapshot" :: held 2.346s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:04 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Created reservations ['a0c4efd2-a91b-4053-ba0e-1d363832b8e4', 'f1b4db35-f18d-4d77-866d-2120f2cc8ee6', 'ffb82d57-6b13-4d08-8edb-ea69936664e3', 'e950695f-05e7-4600-b264-cfa33434dc91'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:52:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Delete snapshot completed successfully. Aug 28 08:52:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-65f5c7d9-b5c2-4a93-b023-4271a098c14f tempest-VolumesExtendTest-1009937486 None] Lock "cinder-e8265065-08b7-4785-98a1-5316d478b2f2-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-aad2a8c1-249a-4378-b6fd-821b5225a4d9-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "cinder-aad2a8c1-249a-4378-b6fd-821b5225a4d9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Acquiring lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffac339-ca3a-49c1-bfd4-0b15dee82871]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:05 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:52:05 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:05 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.441s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:05 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9 Aug 28 08:52:05 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:06 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-aad2a8c1-249a-4378-b6fd-821b5225a4d9" returned: 0 in 0.343s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "cinder-quobyte-aad2a8c1-249a-4378-b6fd-821b5225a4d9" released by "delete_volume" :: held 0.864s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Created reservations ['28da9ee1-8880-42ac-be62-f7a68b8518ce', '54c4d3ea-cda3-4c8a-92f2-a2ac94057dbb', 'f85b36b1-43df-430d-9816-979a1bd31927', 'ae55ba9a-f205-4fd2-82e7-49e2bf796a11'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:06 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:52:06 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:06 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.503s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:52:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Deleted volume successfully. Aug 28 08:52:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea4da23-db2e-492b-9c3c-10cbed92f15c tempest-VolumesExtendTest-1009937486 None] Lock "cinder-aad2a8c1-249a-4378-b6fd-821b5225a4d9-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (c6c3fc2c-fb2e-4a9b-aaef-dc052c9cde45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a15ffb0-2248-470b-a588-af0f5a37c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a15ffb0-2248-470b-a588-af0f5a37c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1130066007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858a0fc-5edd-4921-8eb1-8e2348ea6b31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:14Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daab3fdc-1d34-4fc5-8036-4a210ca6976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daab3fdc-1d34-4fc5-8036-4a210ca6976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d6330f-2c86-4645-b531-353645072428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d6330f-2c86-4645-b531-353645072428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3858a0fc-5edd-4921-8eb1-8e2348ea6b31', 'volume_name': 'volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f5fc34-c43b-4329-ac07-1ddb2742e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f5fc34-c43b-4329-ac07-1ddb2742e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b22f56b-a059-48a8-9498-413c43aa7a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Volume 3858a0fc-5edd-4921-8eb1-8e2348ea6b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31', 'volume_size': 1} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1130066007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858a0fc-5edd-4921-8eb1-8e2348ea6b31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:14Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Creating volume 3858a0fc-5edd-4921-8eb1-8e2348ea6b31 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:52:14 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:52:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:14 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 1073741824 Aug 28 08:52:14 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:15 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 1073741824" returned: 0 in 0.606s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:15 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 Aug 28 08:52:15 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:15 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b22f56b-a059-48a8-9498-413c43aa7a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba43e899-e111-4f88-a296-d11c62f38732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:15 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Volume volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 (3858a0fc-5edd-4921-8eb1-8e2348ea6b31): created successfully Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba43e899-e111-4f88-a296-d11c62f38732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (c6c3fc2c-fb2e-4a9b-aaef-dc052c9cde45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-54cf77cd-2f82-4a6a-9de2-3fb9540be904 tempest-VolumesListTestJSON-1903026646 None] Created volume successfully. Aug 28 08:52:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-39bf6f15-d45a-4b58-95ac-e19a60cf14ab req-1d9f1924-bcea-4bfe-9688-7d194496c54d tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-39bf6f15-d45a-4b58-95ac-e19a60cf14ab req-1d9f1924-bcea-4bfe-9688-7d194496c54d tempest-TestStampPattern-669368986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-39bf6f15-d45a-4b58-95ac-e19a60cf14ab req-1d9f1924-bcea-4bfe-9688-7d194496c54d tempest-TestStampPattern-669368986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-39bf6f15-d45a-4b58-95ac-e19a60cf14ab req-1d9f1924-bcea-4bfe-9688-7d194496c54d tempest-TestStampPattern-669368986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5362838c-84cc-42d0-a657-b8fae7b70510', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:52:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-39bf6f15-d45a-4b58-95ac-e19a60cf14ab req-1d9f1924-bcea-4bfe-9688-7d194496c54d tempest-TestStampPattern-669368986 None] attachment_update completed successfully. Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (afe983dc-1816-46f6-854d-05b0e263cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8d920a-57ca-4470-b5f7-127a75f6b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8d920a-57ca-4470-b5f7-127a75f6b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-377238770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4496dc40-6b75-436f-bcb1-b555be6de0b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:17Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ed2af5-b1c0-4c6f-ad46-621986be1b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ed2af5-b1c0-4c6f-ad46-621986be1b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661f5e87-2dfb-4c54-a681-1d8167df92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661f5e87-2dfb-4c54-a681-1d8167df92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4496dc40-6b75-436f-bcb1-b555be6de0b2', 'volume_name': 'volume-4496dc40-6b75-436f-bcb1-b555be6de0b2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5347cd15-cde9-4d4b-8040-7cf9d019ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5347cd15-cde9-4d4b-8040-7cf9d019ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e89bab-49f6-4eec-9b8d-c9a5d8efae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Volume 4496dc40-6b75-436f-bcb1-b555be6de0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4496dc40-6b75-436f-bcb1-b555be6de0b2', 'volume_size': 1} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-377238770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4496dc40-6b75-436f-bcb1-b555be6de0b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:17Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Creating volume 4496dc40-6b75-436f-bcb1-b555be6de0b2 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:52:17 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:52:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:17 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 1073741824 Aug 28 08:52:17 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:18 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 1073741824" returned: 0 in 0.842s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:18 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 Aug 28 08:52:18 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:18 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2" returned: 0 in 0.387s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e89bab-49f6-4eec-9b8d-c9a5d8efae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4496dc40-6b75-436f-bcb1-b555be6de0b2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e693091-2596-4de7-b0c1-cd2157066f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:18 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Volume volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 (4496dc40-6b75-436f-bcb1-b555be6de0b2): created successfully Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e693091-2596-4de7-b0c1-cd2157066f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (afe983dc-1816-46f6-854d-05b0e263cb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-97c470a8-8fc8-4587-8f48-ebef09a0649d tempest-VolumesListTestJSON-1903026646 None] Created volume successfully. Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Flow 'volume_create_manager' (7cc65a52-ad82-4c06-8032-6a74b52d3988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9324cd1-9653-483f-93cb-8c87740d19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9324cd1-9653-483f-93cb-8c87740d19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1192987622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831f7625-c850-45c5-9dfa-11d66967ad88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3a307e4f594becaffcc06e4a88590b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:20Z,use_quota=True,user_id='e671e1935fc34dea9a9c960d0a23dda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a70bac8-ad81-4723-9713-1725c7661902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a70bac8-ad81-4723-9713-1725c7661902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac66f73-ca22-4a0d-abdc-c1f4bba44a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac66f73-ca22-4a0d-abdc-c1f4bba44a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831f7625-c850-45c5-9dfa-11d66967ad88', 'volume_name': 'volume-831f7625-c850-45c5-9dfa-11d66967ad88', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c58ccbf-caf0-4b81-8df0-2c3a4637850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c58ccbf-caf0-4b81-8df0-2c3a4637850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7d982-cf66-4059-8c11-52daa104ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Volume 831f7625-c850-45c5-9dfa-11d66967ad88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831f7625-c850-45c5-9dfa-11d66967ad88', 'volume_size': 1} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1192987622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831f7625-c850-45c5-9dfa-11d66967ad88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3a307e4f594becaffcc06e4a88590b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:20Z,use_quota=True,user_id='e671e1935fc34dea9a9c960d0a23dda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Creating volume 831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:52:19 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:52:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:19 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 1073741824 Aug 28 08:52:19 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (addc0974-bbdc-40c7-a726-c6ada598fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201e3b47-b82a-4438-bc08-a3cf47c3a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201e3b47-b82a-4438-bc08-a3cf47c3a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985871957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd532b28-45a3-4022-8335-021d7e05ab1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:20Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b22af3e-e062-440d-8f66-8fb8f11eb170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b22af3e-e062-440d-8f66-8fb8f11eb170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f1ccb4-b423-4fd5-a8e1-208df3ae6708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f1ccb4-b423-4fd5-a8e1-208df3ae6708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd532b28-45a3-4022-8335-021d7e05ab1f', 'volume_name': 'volume-fd532b28-45a3-4022-8335-021d7e05ab1f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d331d-496a-4683-999b-a7af077aa85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d331d-496a-4683-999b-a7af077aa85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3896170e-ed5e-47d5-9395-85f0b7801864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Volume fd532b28-45a3-4022-8335-021d7e05ab1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd532b28-45a3-4022-8335-021d7e05ab1f', 'volume_size': 1} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:20 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 1073741824" returned: 0 in 0.656s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:20 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:52:20 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:20 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.278s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985871957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd532b28-45a3-4022-8335-021d7e05ab1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7abc9ab927cb42c792a51834b24a330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:20Z,use_quota=True,user_id='337fc08279884f9cb44a21e4d0b9b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Creating volume fd532b28-45a3-4022-8335-021d7e05ab1f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:52:20 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7d982-cf66-4059-8c11-52daa104ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831f7625-c850-45c5-9dfa-11d66967ad88', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f427a77-8c30-4647-aab5-6014e47c175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:20 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f 1073741824 Aug 28 08:52:20 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Volume volume-831f7625-c850-45c5-9dfa-11d66967ad88 (831f7625-c850-45c5-9dfa-11d66967ad88): created successfully Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f427a77-8c30-4647-aab5-6014e47c175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Flow 'volume_create_manager' (7cc65a52-ad82-4c06-8032-6a74b52d3988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9a217224-88f8-42d9-aa21-6858fc015120 tempest-TestImageHashVerification-240921872 None] Created volume successfully. Aug 28 08:52:21 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f 1073741824" returned: 0 in 0.577s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:21 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f Aug 28 08:52:21 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:21 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f" returned: 0 in 0.290s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3896170e-ed5e-47d5-9395-85f0b7801864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd532b28-45a3-4022-8335-021d7e05ab1f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb929475-2481-47ce-8ce3-3a3ed1e7f55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Volume volume-fd532b28-45a3-4022-8335-021d7e05ab1f (fd532b28-45a3-4022-8335-021d7e05ab1f): created successfully Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb929475-2481-47ce-8ce3-3a3ed1e7f55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Flow 'volume_create_manager' (addc0974-bbdc-40c7-a726-c6ada598fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-02be3af1-8ba1-4e5e-a130-483da3e38549 tempest-VolumesListTestJSON-1903026646 None] Created volume successfully. Aug 28 08:52:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-cc6eea46-c9bf-401a-83fb-021735becf93 req-1b1a5146-811d-4821-8151-9654269e6c74 tempest-TestStampPattern-669368986 None] Terminate volume connection completed successfully. Aug 28 08:52:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-cc6eea46-c9bf-401a-83fb-021735becf93 req-1b1a5146-811d-4821-8151-9654269e6c74 tempest-TestStampPattern-669368986 None] Deleting attachment 5362838c-84cc-42d0-a657-b8fae7b70510. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Creating offline snapshot f55bbda2-60cc-4168-862d-54f1b2c30cfe of volume f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc9d5bb-2a36-40e4-9331-33fb242fa527]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:23 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:52:23 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:24 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.447s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:24 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe 1G Aug 28 08:52:24 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:24 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe 1G" returned: 0 in 0.500s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:24 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:52:24 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:24 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.358s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe is being set with open permissions: ugo+rw Aug 28 08:52:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:24 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:52:24 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:25 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.300s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:25 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info Aug 28 08:52:25 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:25 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:25 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info is being set with open permissions: ugo+rw Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:25 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info Aug 28 08:52:25 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:25 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.info" returned: 0 in 0.321s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.335s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[70792f33-c770-47b2-b201-f5f8168d7712]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-587e4571-f760-4345-9e94-cf4d05e4e3a9 tempest-TestStampPattern-669368986 None] Create snapshot completed successfully Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-fd532b28-45a3-4022-8335-021d7e05ab1f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-fd532b28-45a3-4022-8335-021d7e05ab1f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:26 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:52:26 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-quobyte-fd532b28-45a3-4022-8335-021d7e05ab1f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-fd532b28-45a3-4022-8335-021d7e05ab1f" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bdcb1-8475-4c6d-94ed-e478a0ad0ed6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:26 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f Aug 28 08:52:26 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:26 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.444s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3bf7c-5ee6-4c3e-ba64-bb6d966b4928]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:26 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:52:26 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:26 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f" returned: 0 in 0.414s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:26 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f Aug 28 08:52:26 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:26 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.465s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 /opt/stack/data/cinder/conversion/831f7625-c850-45c5-9dfa-11d66967ad88.temp_image.e304736b-97bf-458d-a0a4-6ec03fe0f6cfyxqy8pz_.img {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:26 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:26 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 /opt/stack/data/cinder/conversion/831f7625-c850-45c5-9dfa-11d66967ad88.temp_image.e304736b-97bf-458d-a0a4-6ec03fe0f6cfyxqy8pz_.img Aug 28 08:52:26 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-fd532b28-45a3-4022-8335-021d7e05ab1f" returned: 0 in 0.339s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-fd532b28-45a3-4022-8335-021d7e05ab1f" released by "delete_volume" :: held 0.805s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Created reservations ['2f7e7c96-e7bb-4272-a568-aa763a6f6a72', 'b6fb1b77-d015-4486-ba33-d41a56f21697', '36b63de3-e86f-4659-a2b6-16b5bb925967', 'd83f18ba-1bd7-48d3-8933-1602cb24c154'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:27 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:52:27 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-4496dc40-6b75-436f-bcb1-b555be6de0b2-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-4496dc40-6b75-436f-bcb1-b555be6de0b2-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-quobyte-4496dc40-6b75-436f-bcb1-b555be6de0b2" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-4496dc40-6b75-436f-bcb1-b555be6de0b2" acquired by "delete_volume" :: waited 0.078s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a92438-1eaa-402c-bba5-9a68bb873bc4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:28 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.242s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:52:28 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 Aug 28 08:52:28 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Deleted volume successfully. Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:INSERT=20,cinder:DELETE=6 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:52:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5170f43-23fc-421a-8b42-774a78d8bc74 tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-fd532b28-45a3-4022-8335-021d7e05ab1f-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:29 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2" returned: 0 in 1.708s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:29 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2 Aug 28 08:52:29 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:30 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4496dc40-6b75-436f-bcb1-b555be6de0b2" returned: 0 in 0.876s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-4496dc40-6b75-436f-bcb1-b555be6de0b2" released by "delete_volume" :: held 2.742s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:30 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=69,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=6 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:52:30 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Created reservations ['bdd70de1-e1d2-4006-b80a-fb37bf803fb2', '0009a985-4a67-4152-b1a4-22d92feec00c', '1b880af0-7658-4b14-9f91-137958d033d0', '2ac1079a-b8a5-4190-8aa7-47880757f6dc'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:31 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:52:31 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-3858a0fc-5edd-4921-8eb1-8e2348ea6b31-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-3858a0fc-5edd-4921-8eb1-8e2348ea6b31-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "cinder-quobyte-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" acquired by "delete_volume" :: waited 0.086s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7322b0-2433-4230-9035-35722e7d200d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:32 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:52:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Deleted volume successfully. Aug 28 08:52:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c2cbff2-be81-4c83-ac64-17c0b7d800fd tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-4496dc40-6b75-436f-bcb1-b555be6de0b2-delete_volume" released by "delete_volume" :: held 5.113s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:33 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 Aug 28 08:52:33 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:34 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" returned: 0 in 1.391s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:34 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31 Aug 28 08:52:34 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:34 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 /opt/stack/data/cinder/conversion/831f7625-c850-45c5-9dfa-11d66967ad88.temp_image.e304736b-97bf-458d-a0a4-6ec03fe0f6cfyxqy8pz_.img" returned: 0 in 7.842s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970b7f6-d14b-469f-be6c-c5e95726d760]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:34 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" returned: 0 in 0.840s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-quobyte-3858a0fc-5edd-4921-8eb1-8e2348ea6b31" released by "delete_volume" :: held 2.376s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:34 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:52:34 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Created reservations ['17b5ea7d-6dff-4a6e-b7dd-e58110ef7f59', 'f1e3a0ed-00a7-48eb-9ac8-9d00e9924d0c', 'f789f61d-f7b4-4419-8e1e-85f30419628b', '3c12bac1-c41c-48be-88ec-a02fe48aafae'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:35 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:52:35 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:35 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.307s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:52:35 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Deleted volume successfully. Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0a99cd64-493e-4e19-8017-91732dad743c tempest-VolumesListTestJSON-1903026646 None] Lock "cinder-3858a0fc-5edd-4921-8eb1-8e2348ea6b31-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:52:35 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.747s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/conversion/831f7625-c850-45c5-9dfa-11d66967ad88.temp_image.e304736b-97bf-458d-a0a4-6ec03fe0f6cfyxqy8pz_.img {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:52:35 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Converted 1024.00 MB image at 130.55 MB/s Aug 28 08:52:35 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] e304736b-97bf-458d-a0a4-6ec03fe0f6cf was raw, no need to convert to raw {{(pid=85762) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:52:40 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:52:40 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:52:40 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.571s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:52:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Flow 'volume_create_manager' (d88427b0-652d-4b6d-8b41-9878b49e1d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3abb9d-5603-462a-a72d-30d726b83aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3abb9d-5603-462a-a72d-30d726b83aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-678161426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafc4418-d91c-4c0c-8588-25fda036ea2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f52386ebbc4029b56f7ba8d4fb58c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f55bbda2-60cc-4168-862d-54f1b2c30cfe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:41Z,use_quota=True,user_id='c4286a01b3534341a31fa0a2ddc8aa0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd2d9fe-de5e-48cd-867f-dd1c3fd48730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd2d9fe-de5e-48cd-867f-dd1c3fd48730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d2a00e-eff7-4287-a5be-dee66e7c9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d2a00e-eff7-4287-a5be-dee66e7c9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eafc4418-d91c-4c0c-8588-25fda036ea2f', 'volume_name': 'volume-eafc4418-d91c-4c0c-8588-25fda036ea2f', 'volume_size': 1, 'snapshot_id': 'f55bbda2-60cc-4168-862d-54f1b2c30cfe'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2532e0d6-10d4-4663-accf-078c9665c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2532e0d6-10d4-4663-accf-078c9665c289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcffc8f-7d00-43aa-b9ed-c2ffe4fbb841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:41 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Volume eafc4418-d91c-4c0c-8588-25fda036ea2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eafc4418-d91c-4c0c-8588-25fda036ea2f', 'volume_size': 1, 'snapshot_id': 'f55bbda2-60cc-4168-862d-54f1b2c30cfe'} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:52:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Flow 'volume_create_manager' (99adbc72-495a-4f0e-9913-8fb1bf7a1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679cfee5-3aa3-42aa-a41e-51e78f4c8e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679cfee5-3aa3-42aa-a41e-51e78f4c8e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-948720705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5acaf2-4f88-4549-8279-d3de4b3a33da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d490a73073401fa6c3a936f2e59a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:42Z,use_quota=True,user_id='3fff8ca80ab3452ea82f0684c6185470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7d3577-6777-4d3e-8dbf-38372d49722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7d3577-6777-4d3e-8dbf-38372d49722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68074889-e014-4696-9eaa-7586fe63c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68074889-e014-4696-9eaa-7586fe63c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5acaf2-4f88-4549-8279-d3de4b3a33da', 'volume_name': 'volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d02eb6d-8517-4581-a289-f61ce386b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d02eb6d-8517-4581-a289-f61ce386b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4010fe4f-2256-4ec7-8818-e5353ed849d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:52:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Volume 8e5acaf2-4f88-4549-8279-d3de4b3a33da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da', 'volume_size': 1} Aug 28 08:52:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:52:51 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:INSERT=4,cinder:UPDATE=17,cinder:SELECT=7,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:52:52 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.448s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Uploaded volume to glance image-id: e304736b-97bf-458d-a0a4-6ec03fe0f6cf. {{(pid=85762) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 26.740s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe-eafc4418-d91c-4c0c-8588-25fda036ea2f" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe-eafc4418-d91c-4c0c-8588-25fda036ea2f" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Creating volume eafc4418-d91c-4c0c-8588-25fda036ea2f from snapshot f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3aee64fe-5728-43d3-b206-93697bf0daa8 tempest-TestImageHashVerification-240921872 None] Copy volume to image completed successfully. Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] snapshot: f55bbda2-60cc-4168-862d-54f1b2c30cfe, volume: eafc4418-d91c-4c0c-8588-25fda036ea2f, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1f186-143f-4d1a-a83f-ec9d528e8d06]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:08 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:53:08 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:09 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.617s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b25dff7-b671-4bb8-8f42-4b91234d354b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:09 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:53:09 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Acquiring lock "cinder-831f7625-c850-45c5-9dfa-11d66967ad88-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "cinder-831f7625-c850-45c5-9dfa-11d66967ad88-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:09 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:09 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f Aug 28 08:53:09 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Acquiring lock "cinder-quobyte-831f7625-c850-45c5-9dfa-11d66967ad88" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "cinder-quobyte-831f7625-c850-45c5-9dfa-11d66967ad88" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7eb471-d89c-4547-b565-a6b3929bf61f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:09 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:53:09 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:10 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.459s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:10 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88 Aug 28 08:53:10 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:11 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-831f7625-c850-45c5-9dfa-11d66967ad88" returned: 0 in 0.857s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "cinder-quobyte-831f7625-c850-45c5-9dfa-11d66967ad88" released by "delete_volume" :: held 1.413s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Created reservations ['d4bcfe4a-89d6-454a-8ebf-ea0dbb92f8aa', 'b59d664f-12de-45fb-8ef2-b9ca78165481', 'd1d66365-d8fc-4f74-86cb-34115b180633', '958c0af9-42e9-4704-add9-1b2b00fd7d94'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:11 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:11 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:12 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.114s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:12 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Deleted volume successfully. Aug 28 08:53:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9015d0ed-2de8-4102-8308-17377c6abe95 tempest-TestImageHashVerification-240921872 None] Lock "cinder-831f7625-c850-45c5-9dfa-11d66967ad88-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:16 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f" returned: 0 in 6.501s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:53:16 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Converted 1024.00 MB image at 157.49 MB/s Aug 28 08:53:16 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f is being set with open permissions: ugo+rw Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:16 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f Aug 28 08:53:16 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:16 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" released by "_copy_volume_from_snapshot" :: held 8.060s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe-eafc4418-d91c-4c0c-8588-25fda036ea2f" released by "_create_volume_from_snapshot" :: held 8.161s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.190s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.520s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-948720705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5acaf2-4f88-4549-8279-d3de4b3a33da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d490a73073401fa6c3a936f2e59a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:52:42Z,use_quota=True,user_id='3fff8ca80ab3452ea82f0684c6185470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Creating volume 8e5acaf2-4f88-4549-8279-d3de4b3a33da {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:16 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:16 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da 1073741824 Aug 28 08:53:16 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcffc8f-7d00-43aa-b9ed-c2ffe4fbb841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafc4418-d91c-4c0c-8588-25fda036ea2f', 'volume_size': 1, 'snapshot_id': 'f55bbda2-60cc-4168-862d-54f1b2c30cfe'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913544bc-009b-41f5-9714-40cf6c23aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Volume volume-eafc4418-d91c-4c0c-8588-25fda036ea2f (eafc4418-d91c-4c0c-8588-25fda036ea2f): created successfully Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913544bc-009b-41f5-9714-40cf6c23aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Flow 'volume_create_manager' (d88427b0-652d-4b6d-8b41-9878b49e1d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fb15739c-438e-4709-9c58-d3c5dc32b08a tempest-TestStampPattern-669368986 None] Created volume successfully. Aug 28 08:53:17 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da 1073741824" returned: 0 in 0.637s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:17 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da Aug 28 08:53:17 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:17 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da" returned: 0 in 0.292s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4010fe4f-2256-4ec7-8818-e5353ed849d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d9949a-53ea-425c-b669-49da4021619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Volume volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da (8e5acaf2-4f88-4549-8279-d3de4b3a33da): created successfully Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d9949a-53ea-425c-b669-49da4021619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Flow 'volume_create_manager' (99adbc72-495a-4f0e-9913-8fb1bf7a1762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-be88903c-e583-4966-9d0b-10fc1cab4084 tempest-VolumesNegativeTest-1856273749 None] Created volume successfully. Aug 28 08:53:27 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:53:27 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=11,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6b72829c-d850-479e-b9d1-706148c1e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b3720b-6b8f-43a5-85ef-54b61f8dcccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b3720b-6b8f-43a5-85ef-54b61f8dcccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890687837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:35Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a7ac1-553a-4edd-bf5f-97df4814b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529a7ac1-553a-4edd-bf5f-97df4814b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac46e79c-7fea-4736-a90b-d79a55d5592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac46e79c-7fea-4736-a90b-d79a55d5592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0', 'volume_name': 'volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc3b750-7dc1-4a42-bd13-23f30c01c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc3b750-7dc1-4a42-bd13-23f30c01c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d4c45-a730-44a5-9107-a366069a6f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:35 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume 4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0', 'volume_size': 1} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890687837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:35Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume 4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:35 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:35 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 1073741824 Aug 28 08:53:35 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:35 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 1073741824" returned: 0 in 0.574s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:35 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 Aug 28 08:53:35 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:36 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d4c45-a730-44a5-9107-a366069a6f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a218bb3-e878-4b44-87a6-5ac0b5e122a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 (4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0): created successfully Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a218bb3-e878-4b44-87a6-5ac0b5e122a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6b72829c-d850-479e-b9d1-706148c1e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f9fa9cf7-788c-4cca-990a-f74b5658a420 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f811d337-afec-468e-8902-57a84387d5f0 req-5596a452-6cd4-4a65-8deb-60108e4130ee tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f811d337-afec-468e-8902-57a84387d5f0 req-5596a452-6cd4-4a65-8deb-60108e4130ee tempest-TestStampPattern-669368986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f811d337-afec-468e-8902-57a84387d5f0 req-5596a452-6cd4-4a65-8deb-60108e4130ee tempest-TestStampPattern-669368986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f811d337-afec-468e-8902-57a84387d5f0 req-5596a452-6cd4-4a65-8deb-60108e4130ee tempest-TestStampPattern-669368986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-eafc4418-d91c-4c0c-8588-25fda036ea2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a27b5d2a-f55c-4969-a531-8f8c30dcbabd', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (9d3b2355-f28c-4e26-af70-bc7e97a96f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c082d5-b6ea-4616-a1df-3e404248b6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f811d337-afec-468e-8902-57a84387d5f0 req-5596a452-6cd4-4a65-8deb-60108e4130ee tempest-TestStampPattern-669368986 None] attachment_update completed successfully. Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c082d5-b6ea-4616-a1df-3e404248b6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-853415065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895ec7db-8aa2-48b5-bb44-35d3b5b3d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:38Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ff5f3-c75d-4ace-ba91-3c719c8974a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ff5f3-c75d-4ace-ba91-3c719c8974a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf433cd-f5ec-4388-b2a8-d1b8e37c2514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf433cd-f5ec-4388-b2a8-d1b8e37c2514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895ec7db-8aa2-48b5-bb44-35d3b5b3d94e', 'volume_name': 'volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adfe5ac-f71a-4ae2-b88a-98d6afd3ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adfe5ac-f71a-4ae2-b88a-98d6afd3ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd0a2f-5f43-4b95-b81f-55928e97f3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:37 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume 895ec7db-8aa2-48b5-bb44-35d3b5b3d94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e', 'volume_size': 1} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-853415065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895ec7db-8aa2-48b5-bb44-35d3b5b3d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:38Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume 895ec7db-8aa2-48b5-bb44-35d3b5b3d94e {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:37 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:37 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e 1073741824 Aug 28 08:53:37 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6181caf4-5ea3-4685-91fe-dd1594dd8a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c12fcce-374a-4d96-8dbe-da6639b2145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c12fcce-374a-4d96-8dbe-da6639b2145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6a948a-1919-446a-9930-ea41eefb521c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:38Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575fc024-5a16-4f56-8e98-0e66053757e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575fc024-5a16-4f56-8e98-0e66053757e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308094ac-283b-460e-b521-7827683d6ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308094ac-283b-460e-b521-7827683d6ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6a948a-1919-446a-9930-ea41eefb521c', 'volume_name': 'volume-0c6a948a-1919-446a-9930-ea41eefb521c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914e3660-c072-4054-8f4b-d823908e4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914e3660-c072-4054-8f4b-d823908e4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0de65-2fae-4f56-a531-454926bf003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume 0c6a948a-1919-446a-9930-ea41eefb521c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6a948a-1919-446a-9930-ea41eefb521c', 'volume_size': 1} Aug 28 08:53:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:39 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e 1073741824" returned: 0 in 1.094s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:39 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e Aug 28 08:53:39 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6e4bce4b-79bd-41b9-be67-0559b370ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76890c6-8b42-445f-958b-373a553f9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76890c6-8b42-445f-958b-373a553f9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230027786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f7ee1c-018d-4ab5-99fc-93b8d569a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:39Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00125f20-a25c-4a08-b47a-af917c0f7974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00125f20-a25c-4a08-b47a-af917c0f7974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64048858-6ac4-4dc3-93c6-4f2608ffe0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64048858-6ac4-4dc3-93c6-4f2608ffe0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f7ee1c-018d-4ab5-99fc-93b8d569a11e', 'volume_name': 'volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6725db0-f919-4856-9759-8dc3dde29c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6725db0-f919-4856-9759-8dc3dde29c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfddbd6a-39ef-4065-976b-0c82bc536acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume 02f7ee1c-018d-4ab5-99fc-93b8d569a11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e', 'volume_size': 1} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:39 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" returned: 0 in 0.602s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6a948a-1919-446a-9930-ea41eefb521c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:38Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume 0c6a948a-1919-446a-9930-ea41eefb521c {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:39 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:39 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c 1073741824 Aug 28 08:53:39 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd0a2f-5f43-4b95-b81f-55928e97f3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f895b21-29f9-4946-92fc-b1f52334070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e (895ec7db-8aa2-48b5-bb44-35d3b5b3d94e): created successfully Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f895b21-29f9-4946-92fc-b1f52334070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (9d3b2355-f28c-4e26-af70-bc7e97a96f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-80090310-9b32-4840-ac5f-21130b6cf3a7 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:40 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (16fb531a-c1cc-4c23-93af-d275fe937a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:40 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29325a4-ab9e-47ad-b366-a0348f9d9178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29325a4-ab9e-47ad-b366-a0348f9d9178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932526056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3454247-11ee-409f-a62d-5dc2f9332a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:40Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5d9fb-1449-4af7-8637-bdc417c61722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5d9fb-1449-4af7-8637-bdc417c61722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a6136b-db17-4b63-bddc-c7ee9f2ecdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a6136b-db17-4b63-bddc-c7ee9f2ecdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3454247-11ee-409f-a62d-5dc2f9332a90', 'volume_name': 'volume-f3454247-11ee-409f-a62d-5dc2f9332a90', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e53a20a-3818-49e2-8429-af33d1498f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e53a20a-3818-49e2-8429-af33d1498f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9098ba-b66f-4463-9485-44d45ee877f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume f3454247-11ee-409f-a62d-5dc2f9332a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3454247-11ee-409f-a62d-5dc2f9332a90', 'volume_size': 1} Aug 28 08:53:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:41 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.859s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:53:41 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c 1073741824" returned: 0 in 1.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:41 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c Aug 28 08:53:41 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (3793ad75-2d4c-43ed-9125-120af3a17ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2870dd4a-9dfc-4277-a533-571481875b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2870dd4a-9dfc-4277-a533-571481875b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630008672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c39223-5251-4560-be09-a3ab5eb45f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:42Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a7d080-7d2f-46fd-8e5c-15d72584340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a7d080-7d2f-46fd-8e5c-15d72584340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a2be2e-8399-4e6b-91da-4f7df80ce699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a2be2e-8399-4e6b-91da-4f7df80ce699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c39223-5251-4560-be09-a3ab5eb45f9f', 'volume_name': 'volume-e7c39223-5251-4560-be09-a3ab5eb45f9f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624cec4b-7986-4fb5-95d0-700c90c1c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624cec4b-7986-4fb5-95d0-700c90c1c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c988e74-07c2-4468-b75a-28ecbce651b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:41 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume e7c39223-5251-4560-be09-a3ab5eb45f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c39223-5251-4560-be09-a3ab5eb45f9f', 'volume_size': 1} Aug 28 08:53:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:42 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c" returned: 0 in 0.605s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230027786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f7ee1c-018d-4ab5-99fc-93b8d569a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:39Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume 02f7ee1c-018d-4ab5-99fc-93b8d569a11e {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:42 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:42 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e 1073741824 Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0de65-2fae-4f56-a531-454926bf003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6a948a-1919-446a-9930-ea41eefb521c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:42 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa697959-ae6e-41b3-8246-1d77c545b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-0c6a948a-1919-446a-9930-ea41eefb521c (0c6a948a-1919-446a-9930-ea41eefb521c): created successfully Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa697959-ae6e-41b3-8246-1d77c545b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6181caf4-5ea3-4685-91fe-dd1594dd8a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d789cc2f-13d1-4ff9-98cb-5d7e09ece797 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-c517a0ca-e31d-4101-bac2-f705e713912f req-6b8381fb-af73-4785-9a00-4963ffbfe402 tempest-TestStampPattern-669368986 None] Terminate volume connection completed successfully. Aug 28 08:53:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-c517a0ca-e31d-4101-bac2-f705e713912f req-6b8381fb-af73-4785-9a00-4963ffbfe402 tempest-TestStampPattern-669368986 None] Deleting attachment a27b5d2a-f55c-4969-a531-8f8c30dcbabd. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:53:43 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e 1073741824" returned: 0 in 1.036s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:43 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e Aug 28 08:53:43 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:43 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.825s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1932526056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3454247-11ee-409f-a62d-5dc2f9332a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:40Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume f3454247-11ee-409f-a62d-5dc2f9332a90 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:43 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:43 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 1073741824 Aug 28 08:53:43 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfddbd6a-39ef-4065-976b-0c82bc536acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994fea21-3a2c-4e05-8af1-e3a51f9bc02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:43 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e (02f7ee1c-018d-4ab5-99fc-93b8d569a11e): created successfully Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994fea21-3a2c-4e05-8af1-e3a51f9bc02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (6e4bce4b-79bd-41b9-be67-0559b370ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b948a77b-1bdf-4556-bb12-49c6b184fdbd tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-e5429a96-d3be-45d4-b67e-65a5d60a62da tempest-ServerActionsTestOtherA-768164863 None] Terminate volume connection completed successfully. Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-e5429a96-d3be-45d4-b67e-65a5d60a62da tempest-ServerActionsTestOtherA-768164863 None] Deleting attachment f2fcc0b1-9e72-4a61-bf2f-18c5cfb5f804. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:53:44 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 1073741824" returned: 0 in 0.852s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:44 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 Aug 28 08:53:44 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "cinder-5ae66753-e6f3-4369-b150-6f445b46a1bc-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-5ae66753-e6f3-4369-b150-6f445b46a1bc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "cinder-quobyte-5ae66753-e6f3-4369-b150-6f445b46a1bc" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-quobyte-5ae66753-e6f3-4369-b150-6f445b46a1bc" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9730b8be-729c-4d63-9b7d-82c31e7b090b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:45 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc Aug 28 08:53:45 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:45 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90" returned: 0 in 0.687s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.318s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630008672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c39223-5251-4560-be09-a3ab5eb45f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0c37b5e06247128d7f7954f8a78303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:53:42Z,use_quota=True,user_id='bd9c655d5898478d8fd65951a5490538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Creating volume e7c39223-5251-4560-be09-a3ab5eb45f9f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:53:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9098ba-b66f-4463-9485-44d45ee877f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3454247-11ee-409f-a62d-5dc2f9332a90', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54babcb4-7682-408c-b86a-b47c8dc73a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:45 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f 1073741824 Aug 28 08:53:45 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-f3454247-11ee-409f-a62d-5dc2f9332a90 (f3454247-11ee-409f-a62d-5dc2f9332a90): created successfully Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54babcb4-7682-408c-b86a-b47c8dc73a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (16fb531a-c1cc-4c23-93af-d275fe937a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0671ec12-0459-4751-bbca-16dac4bab908 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:45 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc" returned: 0 in 0.904s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:45 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc Aug 28 08:53:45 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:46 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f 1073741824" returned: 0 in 1.195s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:46 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f Aug 28 08:53:46 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:46 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ae66753-e6f3-4369-b150-6f445b46a1bc" returned: 0 in 0.888s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-quobyte-5ae66753-e6f3-4369-b150-6f445b46a1bc" released by "delete_volume" :: held 1.903s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:46 devstack cinder-volume[85762]: DEBUG cinder.quota [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Created reservations ['2e084193-244e-46a0-b350-d92ce16688ee', 'd9d16e0e-6485-4e18-92f0-562007749308', '2ab336e8-3165-4668-bc68-3b145bde57ff', '07468254-1e2a-41c8-a707-eff6dd0035ed'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:47 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:47 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:47 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f" returned: 0 in 0.581s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c988e74-07c2-4468-b75a-28ecbce651b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c39223-5251-4560-be09-a3ab5eb45f9f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475e448e-a4f3-4937-8afe-501b97e41bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:53:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Volume volume-e7c39223-5251-4560-be09-a3ab5eb45f9f (e7c39223-5251-4560-be09-a3ab5eb45f9f): created successfully Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475e448e-a4f3-4937-8afe-501b97e41bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Flow 'volume_create_manager' (3793ad75-2d4c-43ed-9125-120af3a17ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:53:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-de9732bf-412c-4287-a3d7-ff76762fb554 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created volume successfully. Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-e7c39223-5251-4560-be09-a3ab5eb45f9f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:47 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-e7c39223-5251-4560-be09-a3ab5eb45f9f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.711s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.manager [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Deleted volume successfully. Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-e7c39223-5251-4560-be09-a3ab5eb45f9f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-fb77c61f-e258-42d4-a86d-a06a7bc9fa34 req-c2d704ee-3a0d-4e0c-a26e-62555c8806ba tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-5ae66753-e6f3-4369-b150-6f445b46a1bc-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-e7c39223-5251-4560-be09-a3ab5eb45f9f" acquired by "delete_volume" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "cinder-45ace101-d35d-46da-8db3-701e180239d4-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc788905-086d-4a4c-9c96-64389035fab5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-45ace101-d35d-46da-8db3-701e180239d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "cinder-quobyte-45ace101-d35d-46da-8db3-701e180239d4" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-quobyte-45ace101-d35d-46da-8db3-701e180239d4" acquired by "delete_volume" :: waited 0.056s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:48 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f Aug 28 08:53:48 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db4977a-de73-4386-8c45-bca6f311759d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:48 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 Aug 28 08:53:48 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:48 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:48 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f Aug 28 08:53:48 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Acquiring lock "cinder-8e5acaf2-4f88-4549-8279-d3de4b3a33da-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "cinder-8e5acaf2-4f88-4549-8279-d3de4b3a33da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:48 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4" returned: 0 in 0.613s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:48 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4 Aug 28 08:53:48 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Acquiring lock "cinder-quobyte-8e5acaf2-4f88-4549-8279-d3de4b3a33da" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "cinder-quobyte-8e5acaf2-4f88-4549-8279-d3de4b3a33da" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20171c6-ad3c-475f-99d4-f7ab6aa577f4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e7c39223-5251-4560-be09-a3ab5eb45f9f" returned: 0 in 0.458s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-e7c39223-5251-4560-be09-a3ab5eb45f9f" released by "delete_volume" :: held 1.144s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-eafc4418-d91c-4c0c-8588-25fda036ea2f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "cinder-eafc4418-d91c-4c0c-8588-25fda036ea2f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:49 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da Aug 28 08:53:49 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['3e27ea56-ddfb-47dc-a2da-e8d97276128a', 'e6dd326a-40c2-40fc-a2e0-7bbffad722ae', 'ca970b16-0a79-4e5c-85c1-6f837f16e518', '9f2e6f74-10f5-49be-9f27-752c8f7afc48'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:49 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-45ace101-d35d-46da-8db3-701e180239d4" returned: 0 in 0.481s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ed54f-31d3-44d0-8152-220d36e15bdf]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-quobyte-45ace101-d35d-46da-8db3-701e180239d4" released by "delete_volume" :: held 1.180s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Created reservations ['bfeabf13-192d-4cef-98b0-98c4138db2be', '6352055a-1bc6-4373-9f47-62a728958a60', '6de1c93e-f711-4904-a3a9-044c5f64358c', '9dd59e97-9100-43de-97b8-803dacd40c72'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:49 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:49 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da" returned: 0 in 0.607s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da Aug 28 08:53:49 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:49 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.396s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:53:49 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8e5acaf2-4f88-4549-8279-d3de4b3a33da" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f" returned: 0 in 0.555s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "cinder-quobyte-8e5acaf2-4f88-4549-8279-d3de4b3a33da" released by "delete_volume" :: held 0.977s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:49 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f Aug 28 08:53:49 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-795f982d-0abe-4400-8f64-096cebb1e89e tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-e7c39223-5251-4560-be09-a3ab5eb45f9f-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:49 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.342s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Deleted volume successfully. Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b48548cf-8ce2-4b38-9fe6-5c4dec22c091 tempest-ServerActionsTestOtherA-768164863 None] Lock "cinder-45ace101-d35d-46da-8db3-701e180239d4-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Created reservations ['189cb756-e9c4-4813-a05b-4a61106442da', '46738bce-4465-43ab-96d9-ee27a425cd99', 'b21b967b-c542-4a1d-87b0-3cce30c3eb7a', '72136b08-f11d-47d5-915e-3ab91b9225c1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:50 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:50 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:50 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-eafc4418-d91c-4c0c-8588-25fda036ea2f" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-eafc4418-d91c-4c0c-8588-25fda036ea2f" released by "delete_volume" :: held 0.941s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Created reservations ['f9d7859c-48ff-4709-a74b-980565cc21e6', 'e07e46ff-3c39-48c0-b1db-2fe25a22455e', '947ac78a-45ee-4073-b96b-4f68533dfcc1', '72c06e8a-6e4b-49da-a7d4-fa03380d5740'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-f3454247-11ee-409f-a62d-5dc2f9332a90-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-f3454247-11ee-409f-a62d-5dc2f9332a90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:50 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:50 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:50 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-f3454247-11ee-409f-a62d-5dc2f9332a90" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Deleted volume successfully. Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-f3454247-11ee-409f-a62d-5dc2f9332a90" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c346a728-3ebb-498c-a908-bff6b359eaf8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-884881fe-9b13-47a6-840d-10d21dde6d1c tempest-VolumesNegativeTest-1856273749 None] Lock "cinder-8e5acaf2-4f88-4549-8279-d3de4b3a33da-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:50 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 Aug 28 08:53:50 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:50 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.454s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Deleted volume successfully. Aug 28 08:53:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9ef5f20b-32c5-4e88-a199-73910c7e8f05 tempest-TestStampPattern-669368986 None] Lock "cinder-eafc4418-d91c-4c0c-8588-25fda036ea2f-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:51 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90" returned: 0 in 0.585s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:51 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90 Aug 28 08:53:51 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:51 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f3454247-11ee-409f-a62d-5dc2f9332a90" returned: 0 in 0.532s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-f3454247-11ee-409f-a62d-5dc2f9332a90" released by "delete_volume" :: held 1.183s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['4d4e21d0-f926-4c1f-9be6-a19ec32a951b', '37f77792-dc63-48c8-a86e-743fa26affb4', 'a521129c-83c5-43eb-9ea7-8ae0dc675465', '63934efc-ea6d-4dcd-80e7-2c1ff9a75541'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:51 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:51 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-f55bbda2-60cc-4168-862d-54f1b2c30cfe-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-f55bbda2-60cc-4168-862d-54f1b2c30cfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Deleting offline snapshot f55bbda2-60cc-4168-862d-54f1b2c30cfe of volume f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] snapshot_file for this snap is: volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4039050a-97f0-4963-8caf-78b763ed0d95]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:52 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.472s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:52 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:53:52 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:53:52 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-abf8a7a2-dbf8-423c-88a4-03d473d8a31c tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-f3454247-11ee-409f-a62d-5dc2f9332a90-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-02f7ee1c-018d-4ab5-99fc-93b8d569a11e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-02f7ee1c-018d-4ab5-99fc-93b8d569a11e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:52 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.711s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e51e598-536e-4a48-9901-91fd02c48b98]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a4215-9e45-4fe1-9e4a-f599f26c5a91]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:53 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:53:53 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:53 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e Aug 28 08:53:53 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:53 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" returned: 0 in 0.534s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:53 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e Aug 28 08:53:53 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:53 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.754s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:53 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:53:53 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:53 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" returned: 0 in 0.296s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-02f7ee1c-018d-4ab5-99fc-93b8d569a11e" released by "delete_volume" :: held 0.885s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['7157cee3-f13a-40e8-b7ad-cf0afbce7212', '52572af2-cb4d-4b18-b153-797c93fcf492', '3e20b0d0-0ee0-4769-9799-613c0d8ef1a9', '7d690834-61c1-42c8-b05f-8a08584a8d82'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:54 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:54 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:54 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.518s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:54 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe Aug 28 08:53:54 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:54 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.311s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-97dc1d45-a116-449b-9ed0-caadac526d33 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-02f7ee1c-018d-4ab5-99fc-93b8d569a11e-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:54 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335.f55bbda2-60cc-4168-862d-54f1b2c30cfe" returned: 0 in 0.343s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f55bbda2-60cc-4168-862d-54f1b2c30cfe" released by "_delete_snapshot" :: held 2.523s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" released by "delete_snapshot" :: held 2.561s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Created reservations ['64b4ecf7-1d24-4baa-ab62-0cc2201a753c', '77ba5842-9fe2-4d82-9ccc-127e1f707de8', '96809419-54c9-418b-b284-411ef8fa34e5', '623afd43-c9e7-4dd3-bbaa-e79d5393a784'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Delete snapshot completed successfully. Aug 28 08:53:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f312928b-30c9-4189-a38f-512ee8ccb261 tempest-TestStampPattern-669368986 None] Lock "cinder-f55bbda2-60cc-4168-862d-54f1b2c30cfe-delete_snapshot" released by "delete_snapshot" :: held 2.752s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-0c6a948a-1919-446a-9930-ea41eefb521c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-0c6a948a-1919-446a-9930-ea41eefb521c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-0c6a948a-1919-446a-9930-ea41eefb521c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-0c6a948a-1919-446a-9930-ea41eefb521c" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ed2c4-22ef-41f3-b01e-381994818281]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:55 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c Aug 28 08:53:55 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:55 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c" returned: 0 in 0.430s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:55 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c Aug 28 08:53:55 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:56 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-0c6a948a-1919-446a-9930-ea41eefb521c" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-0c6a948a-1919-446a-9930-ea41eefb521c" released by "delete_volume" :: held 0.858s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['268d1bed-679d-47cf-bde7-0e0d857f18f3', 'b5ada150-e87c-4f4b-8026-83e53de7b7c8', 'ccfc4081-ad59-4846-b94e-ce9922272fd2', '55dffbaa-cf13-41d3-98d1-7e3620656dfc'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:56 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:56 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4407a7-6322-4c39-bc64-cb8699693239]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:56 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.364s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:53:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2213985d-5c2f-455a-a3f8-c769d76630a2 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-0c6a948a-1919-446a-9930-ea41eefb521c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:56 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e Aug 28 08:53:56 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:57 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" returned: 0 in 0.498s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:57 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e Aug 28 08:53:57 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:57 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" returned: 0 in 0.386s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e" released by "delete_volume" :: held 0.948s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['66701afa-d8a7-4987-98bb-1895ad51c913', '572faa9c-614c-4b02-8e31-45187b26bac9', '8bc3dd1b-ba7d-49de-b880-0c1be1217ca4', 'bacc6228-ba77-44cf-8648-248d848eb042'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:53:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:57 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:53:57 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:58 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.549s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:58 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:53:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:53:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0cd79cc4-8f45-40d6-adf1-6b7fd95beeb3 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-895ec7db-8aa2-48b5-bb44-35d3b5b3d94e-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:53:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "cinder-quobyte-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[587352dd-943e-4694-b31c-2209058218ca]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:59 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 Aug 28 08:53:59 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:53:59 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" returned: 0 in 0.579s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:53:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:53:59 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0 Aug 28 08:53:59 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:00 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" returned: 0 in 0.423s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-quobyte-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0" released by "delete_volume" :: held 1.076s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Created reservations ['0c0cac37-a7a7-4b13-ace1-e03bdde4a935', '9b4a776a-8e75-4202-aa00-40566702db3e', 'cfcf91d0-658a-4f15-a613-f09eaeea11e7', 'b7678adc-53db-4ef0-bb21-01cb89e80907'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:00 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:54:00 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:00 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.346s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:54:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Deleted volume successfully. Aug 28 08:54:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2afda8ba-7b5c-4060-9b2f-8001783069d9 tempest-CreateVolumesFromSourceVolumeTest-1547721881 None] Lock "cinder-4e9f5e3b-e54b-4193-bf2d-c5ab53cf3ee0-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-f09dc3be-9f96-4b3e-912c-66cbf35fa335-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "cinder-f09dc3be-9f96-4b3e-912c-66cbf35fa335-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Acquiring lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb39d31-f923-486f-af5f-8622328b5969]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:04 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:54:04 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:04 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.560s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:04 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335 Aug 28 08:54:04 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:05 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f09dc3be-9f96-4b3e-912c-66cbf35fa335" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "cinder-quobyte-f09dc3be-9f96-4b3e-912c-66cbf35fa335" released by "delete_volume" :: held 1.014s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Created reservations ['ff56898d-7459-4af6-b18e-35215de0979b', '1e87f7a6-8df1-4318-9dd6-2de2acf46ed0', 'd1aa2000-e5cb-402b-a37b-cf4f23c2b178', '7b821f98-a9f3-4c36-9431-fa320359a762'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:05 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:54:05 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:06 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.564s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:06 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:54:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Deleted volume successfully. Aug 28 08:54:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bec2e59a-3e78-44f7-b874-79ebdaaad28b tempest-TestStampPattern-669368986 None] Lock "cinder-f09dc3be-9f96-4b3e-912c-66cbf35fa335-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Flow 'volume_create_manager' (12763305-b36e-4c06-85ff-07c4c04e3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2524b5c-83ad-4973-956e-4caeca436d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2524b5c-83ad-4973-956e-4caeca436d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2122559265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41168122-1053-4ffe-a41e-035ab03ea192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17559b1c3d34f9db2d512003483d7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:08Z,use_quota=True,user_id='db40acb5474c48e187081f1e8e907eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4157b694-ffb4-453a-9db6-c79c3555be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4157b694-ffb4-453a-9db6-c79c3555be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a911dab4-fa83-4dbd-aa69-db1ffa592d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a911dab4-fa83-4dbd-aa69-db1ffa592d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41168122-1053-4ffe-a41e-035ab03ea192', 'volume_name': 'volume-41168122-1053-4ffe-a41e-035ab03ea192', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e915910-a82d-499e-b12d-bbbc344bc199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e915910-a82d-499e-b12d-bbbc344bc199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7311bf36-ba26-4402-ba4d-9c38cd939e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:08 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Volume 41168122-1053-4ffe-a41e-035ab03ea192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41168122-1053-4ffe-a41e-035ab03ea192', 'volume_size': 1} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2122559265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41168122-1053-4ffe-a41e-035ab03ea192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17559b1c3d34f9db2d512003483d7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:08Z,use_quota=True,user_id='db40acb5474c48e187081f1e8e907eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Creating volume 41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:08 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:08 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 1073741824 Aug 28 08:54:08 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:08 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 1073741824" returned: 0 in 0.657s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:09 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:09 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:09 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.386s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7311bf36-ba26-4402-ba4d-9c38cd939e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41168122-1053-4ffe-a41e-035ab03ea192', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afffe79a-7772-4a01-b184-3fab1c6545c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Volume volume-41168122-1053-4ffe-a41e-035ab03ea192 (41168122-1053-4ffe-a41e-035ab03ea192): created successfully Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afffe79a-7772-4a01-b184-3fab1c6545c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Flow 'volume_create_manager' (12763305-b36e-4c06-85ff-07c4c04e3159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1708b427-16e2-4f53-afa8-e908473cf983 tempest-VolumeDependencyTests-1125056778 None] Created volume successfully. Aug 28 08:54:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Creating offline snapshot 463e361c-8248-40fb-8361-f0cad172990a of volume 41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:54:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecabba3-85f8-4e2a-9dd9-299ba7358ab8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:10 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:10 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:11 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.582s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:11 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a 1G Aug 28 08:54:11 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:11 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a 1G" returned: 0 in 0.719s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41168122-1053-4ffe-a41e-035ab03ea192 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:11 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41168122-1053-4ffe-a41e-035ab03ea192 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:11 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:12 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41168122-1053-4ffe-a41e-035ab03ea192 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.413s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:12 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a is being set with open permissions: ugo+rw Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:12 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:12 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:12 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.356s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:12 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info Aug 28 08:54:12 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:12 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info" returned: 0 in 0.292s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:12 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info is being set with open permissions: ugo+rw Aug 28 08:54:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:13 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info Aug 28 08:54:13 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:13 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.info" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f10785fe-592a-4d75-b1bc-6cd17d556177 tempest-VolumeDependencyTests-1125056778 None] Create snapshot completed successfully Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Flow 'volume_create_manager' (510d9093-ddbc-47f2-b08c-ff827b350597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c875b99-79e0-48db-9092-6e60c02bcb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c875b99-79e0-48db-9092-6e60c02bcb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-544685224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50429642-04b1-482f-9294-38a9955a4b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17559b1c3d34f9db2d512003483d7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=463e361c-8248-40fb-8361-f0cad172990a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:14Z,use_quota=True,user_id='db40acb5474c48e187081f1e8e907eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0cffd6-c31f-4bdf-a1e9-04671c19013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0cffd6-c31f-4bdf-a1e9-04671c19013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1de98bc-7dc6-4038-ab28-5c7852d06611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1de98bc-7dc6-4038-ab28-5c7852d06611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50429642-04b1-482f-9294-38a9955a4b0c', 'volume_name': 'volume-50429642-04b1-482f-9294-38a9955a4b0c', 'volume_size': 1, 'snapshot_id': '463e361c-8248-40fb-8361-f0cad172990a'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea77405-0812-44c1-9acd-d30def63ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea77405-0812-44c1-9acd-d30def63ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364afbf-5c81-42cd-b0f0-861b108a01fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Volume 50429642-04b1-482f-9294-38a9955a4b0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50429642-04b1-482f-9294-38a9955a4b0c', 'volume_size': 1, 'snapshot_id': '463e361c-8248-40fb-8361-f0cad172990a'} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a-50429642-04b1-482f-9294-38a9955a4b0c" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a-50429642-04b1-482f-9294-38a9955a4b0c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Creating volume 50429642-04b1-482f-9294-38a9955a4b0c from snapshot 463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] snapshot: 463e361c-8248-40fb-8361-f0cad172990a, volume: 50429642-04b1-482f-9294-38a9955a4b0c, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d18c2-9c37-4dc1-a6c4-46aeff6d8f3e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:15 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:15 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:15 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41168122-1053-4ffe-a41e-035ab03ea192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[203446b3-7fbe-4d5b-99fd-84ee20afd3ba]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:15 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:15 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:15 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:54:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:15 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c Aug 28 08:54:15 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:21 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c" returned: 0 in 5.985s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:21 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:54:21 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Converted 1024.00 MB image at 171.04 MB/s Aug 28 08:54:21 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c is being set with open permissions: ugo+rw Aug 28 08:54:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:21 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c Aug 28 08:54:21 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:22 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c" returned: 0 in 0.338s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" released by "_copy_volume_from_snapshot" :: held 7.391s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a-50429642-04b1-482f-9294-38a9955a4b0c" released by "_create_volume_from_snapshot" :: held 7.492s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.526s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364afbf-5c81-42cd-b0f0-861b108a01fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50429642-04b1-482f-9294-38a9955a4b0c', 'volume_size': 1, 'snapshot_id': '463e361c-8248-40fb-8361-f0cad172990a'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee636d-7706-4d5a-95f3-2e8c577be323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Volume volume-50429642-04b1-482f-9294-38a9955a4b0c (50429642-04b1-482f-9294-38a9955a4b0c): created successfully Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ee636d-7706-4d5a-95f3-2e8c577be323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Flow 'volume_create_manager' (510d9093-ddbc-47f2-b08c-ff827b350597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6253673c-ba6c-4dea-9991-60d701f14461 tempest-VolumeDependencyTests-1125056778 None] Created volume successfully. Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-463e361c-8248-40fb-8361-f0cad172990a-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-463e361c-8248-40fb-8361-f0cad172990a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Deleting offline snapshot 463e361c-8248-40fb-8361-f0cad172990a of volume 41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] snapshot_file for this snap is: volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba53538a-2fde-4728-882d-5ca327fb063a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:22 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:22 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:23 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.505s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41168122-1053-4ffe-a41e-035ab03ea192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:54:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c7596-a0c5-4196-8ad5-33bf874311e6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:23 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:23 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:24 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.697s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:24 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:24 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:24 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.445s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:24 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a Aug 28 08:54:24 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:24 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192.463e361c-8248-40fb-8361-f0cad172990a" returned: 0 in 0.324s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-463e361c-8248-40fb-8361-f0cad172990a" released by "_delete_snapshot" :: held 2.121s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" released by "delete_snapshot" :: held 2.150s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Created reservations ['361ac0e7-8851-4fe1-9529-4c8396c25601', '4e2b6ddd-61a4-4377-a9f0-724a27b80723', 'e012dfab-4661-4ba9-b90e-0cd5181f298f', 'f5f11b78-093b-49be-8e0d-8c84da17dfdb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Delete snapshot completed successfully. Aug 28 08:54:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-649a5b69-67bd-4125-8dd3-fcb0cdaec236 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-463e361c-8248-40fb-8361-f0cad172990a-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-41168122-1053-4ffe-a41e-035ab03ea192-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-41168122-1053-4ffe-a41e-035ab03ea192-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f7729-e1f5-4907-acaa-82cf170b0e49]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:26 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:26 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:26 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.526s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:26 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192 Aug 28 08:54:26 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:27 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-41168122-1053-4ffe-a41e-035ab03ea192" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-41168122-1053-4ffe-a41e-035ab03ea192" released by "delete_volume" :: held 1.078s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Created reservations ['0a59c953-b20c-4855-a805-3f008b5d572a', 'c210da66-cfc2-49fa-bd24-26e600d692ab', 'b48188d3-a930-4f02-a30b-f06b003d7ca5', '5972586c-6053-4427-9b44-1a2814842b6a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:27 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:54:27 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:27 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:54:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Deleted volume successfully. Aug 28 08:54:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8f48b707-5b3b-4724-a930-c8538a021014 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-41168122-1053-4ffe-a41e-035ab03ea192-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-50429642-04b1-482f-9294-38a9955a4b0c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-50429642-04b1-482f-9294-38a9955a4b0c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=139,cinder:SELECT=111,cinder:INSERT=29,cinder:DELETE=6 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=92,cinder:UPDATE=131,cinder:INSERT=36,cinder:DELETE=15 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcce808a-39bc-4ab4-89fe-469c752dfc72]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:28 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c Aug 28 08:54:28 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:28 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c" returned: 0 in 0.489s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:29 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c Aug 28 08:54:29 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:29 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50429642-04b1-482f-9294-38a9955a4b0c" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-quobyte-50429642-04b1-482f-9294-38a9955a4b0c" released by "delete_volume" :: held 0.901s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Created reservations ['01d42bfa-05b2-4074-ab73-fb6572252490', '89b9bacd-ec8c-4e0f-9070-d5b52dcc0733', '0f18fbb6-960e-4855-853d-9628ae35f781', 'b52d7ad2-0898-4bbe-8665-93bd226d142a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:29 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:54:29 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:29 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.276s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:54:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Deleted volume successfully. Aug 28 08:54:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e2c25061-e547-48e6-9e10-7572bc756c55 tempest-VolumeDependencyTests-1125056778 None] Lock "cinder-50429642-04b1-482f-9294-38a9955a4b0c-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:37 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Flow 'volume_create_manager' (c2162e56-16a9-4b7d-b598-50e2deec697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d78a19-9875-4a89-b85e-622c2a780e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d78a19-9875-4a89-b85e-622c2a780e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfedc01-b212-4d37-aae2-5f70b28423d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d305086f5e4c438be108503d375dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:38Z,use_quota=True,user_id='45ea8e50710d40fab0e3fb7558200c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed7c65-da93-4f10-bc55-c12620023dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed7c65-da93-4f10-bc55-c12620023dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d88657-9bcf-4f4b-8109-1cc9b0a58bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d88657-9bcf-4f4b-8109-1cc9b0a58bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfedc01-b212-4d37-aae2-5f70b28423d0', 'volume_name': 'volume-7cfedc01-b212-4d37-aae2-5f70b28423d0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ad626b-1014-46fa-a9ed-4173446d188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ad626b-1014-46fa-a9ed-4173446d188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a293ac69-9d78-4a8f-98ce-12195395ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Volume 7cfedc01-b212-4d37-aae2-5f70b28423d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfedc01-b212-4d37-aae2-5f70b28423d0', 'volume_size': 1} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfedc01-b212-4d37-aae2-5f70b28423d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d305086f5e4c438be108503d375dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:38Z,use_quota=True,user_id='45ea8e50710d40fab0e3fb7558200c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Creating volume 7cfedc01-b212-4d37-aae2-5f70b28423d0 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:38 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:38 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 1073741824 Aug 28 08:54:38 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:38 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 1073741824" returned: 0 in 0.810s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:39 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 Aug 28 08:54:39 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:39 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a293ac69-9d78-4a8f-98ce-12195395ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfedc01-b212-4d37-aae2-5f70b28423d0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435bb8a3-64ee-433f-9381-79ff2c212ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Volume volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 (7cfedc01-b212-4d37-aae2-5f70b28423d0): created successfully Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435bb8a3-64ee-433f-9381-79ff2c212ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Flow 'volume_create_manager' (c2162e56-16a9-4b7d-b598-50e2deec697d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:39 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8c684c29-acc3-4ab8-9e7c-084a4219234c tempest-CinderUnicodeTest-364679869 None] Created volume successfully. Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:40 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:54:40 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (e45605a7-b10c-4002-8897-635f863c3e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c1d3b9-31a0-4c55-8e9c-b041fd798de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c1d3b9-31a0-4c55-8e9c-b041fd798de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293974065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6a944a-f6e4-420f-a21d-9a1715556c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:40Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ca543f-8152-4e44-9b3a-2b2ebcdebfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ca543f-8152-4e44-9b3a-2b2ebcdebfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cd7c4e-0419-40cd-a39f-f3d5cc58f80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cd7c4e-0419-40cd-a39f-f3d5cc58f80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6a944a-f6e4-420f-a21d-9a1715556c0b', 'volume_name': 'volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc00d08d-da5e-4a6d-b61a-0dc2270a44ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc00d08d-da5e-4a6d-b61a-0dc2270a44ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f753a4af-1996-4616-856d-98b1ff878055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume 1f6a944a-f6e4-420f-a21d-9a1715556c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b', 'volume_size': 1} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293974065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6a944a-f6e4-420f-a21d-9a1715556c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:40Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume 1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:40 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:40 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b 1073741824 Aug 28 08:54:40 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:40 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:54:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Flow 'volume_create_manager' (6cdd4a12-cacf-4c07-9011-094e25728ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885125ea-18e1-4784-a8df-895aecfe50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885125ea-18e1-4784-a8df-895aecfe50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-770186767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b3a26c-8f68-426b-bcc6-68af0e914289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d305086f5e4c438be108503d375dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:41Z,use_quota=True,user_id='45ea8e50710d40fab0e3fb7558200c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e066aa-509e-4125-9782-9c0204d981fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e066aa-509e-4125-9782-9c0204d981fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59469e80-778a-4b32-bdd0-8bf8dc3ae725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59469e80-778a-4b32-bdd0-8bf8dc3ae725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b3a26c-8f68-426b-bcc6-68af0e914289', 'volume_name': 'volume-32b3a26c-8f68-426b-bcc6-68af0e914289', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80772cdc-a947-48ab-9c0f-951436f6e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80772cdc-a947-48ab-9c0f-951436f6e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b952c891-009f-469f-a4b0-5c79e304b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:41 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Volume 32b3a26c-8f68-426b-bcc6-68af0e914289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b3a26c-8f68-426b-bcc6-68af0e914289', 'volume_size': 1} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:41 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b 1073741824" returned: 0 in 0.817s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:41 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b Aug 28 08:54:41 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:42 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b" returned: 0 in 0.518s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-770186767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b3a26c-8f68-426b-bcc6-68af0e914289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d305086f5e4c438be108503d375dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:41Z,use_quota=True,user_id='45ea8e50710d40fab0e3fb7558200c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Creating volume 32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:42 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f753a4af-1996-4616-856d-98b1ff878055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:42 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 1073741824 Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac873cb-5322-483b-929b-13669ba8b608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:42 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b (1f6a944a-f6e4-420f-a21d-9a1715556c0b): created successfully Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac873cb-5322-483b-929b-13669ba8b608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (e45605a7-b10c-4002-8897-635f863c3e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-481b4803-a824-47a7-9585-00f911ece739 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:54:43 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 1073741824" returned: 0 in 1.111s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:43 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 Aug 28 08:54:43 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:44 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289" returned: 0 in 0.549s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.471s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b952c891-009f-469f-a4b0-5c79e304b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b3a26c-8f68-426b-bcc6-68af0e914289', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6809bd-e23e-43e9-9375-85a7f189316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating offline snapshot d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf of volume 1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:54:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Volume volume-32b3a26c-8f68-426b-bcc6-68af0e914289 (32b3a26c-8f68-426b-bcc6-68af0e914289): created successfully Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6809bd-e23e-43e9-9375-85a7f189316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Flow 'volume_create_manager' (6cdd4a12-cacf-4c07-9011-094e25728ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9588d82-d865-403a-970d-6d1883dfd39e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-09eeeefc-a33e-47fe-b983-6e674b581311 tempest-CinderUnicodeTest-364679869 None] Created volume successfully. Aug 28 08:54:44 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b Aug 28 08:54:44 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:45 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b" returned: 0 in 0.971s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:45 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf 1G Aug 28 08:54:45 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:45 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf 1G" returned: 0 in 0.808s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:46 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf Aug 28 08:54:46 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:46 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" returned: 0 in 0.628s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:46 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf is being set with open permissions: ugo+rw Aug 28 08:54:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:46 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf Aug 28 08:54:46 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:46 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" returned: 0 in 0.365s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:47 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info Aug 28 08:54:47 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:47 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info" returned: 0 in 0.403s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:47 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info is being set with open permissions: ugo+rw Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:47 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info Aug 28 08:54:47 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:47 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.info" returned: 0 in 0.494s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.906s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.331s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Creating offline snapshot 86171b24-0574-4778-9a83-8645a9b73abd of volume 32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:54:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd3872-6620-4ea1-905b-64426fde558d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-031ac7d1-476c-4ecb-970c-9967e4f25a00 tempest-CreateVolumesFromSnapshotTest-536808378 None] Create snapshot completed successfully Aug 28 08:54:48 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 Aug 28 08:54:48 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:48 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289" returned: 0 in 0.554s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:48 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd 1G Aug 28 08:54:48 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:49 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd 1G" returned: 0 in 0.802s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b3a26c-8f68-426b-bcc6-68af0e914289 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:49 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b3a26c-8f68-426b-bcc6-68af0e914289 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd Aug 28 08:54:49 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:50 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (ef026839-42d3-4e61-b738-64f9a7807a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2979520-876a-46eb-86e7-398faca31d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b3a26c-8f68-426b-bcc6-68af0e914289 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd" returned: 0 in 0.789s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:50 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd is being set with open permissions: ugo+rw Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:50 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd Aug 28 08:54:50 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2979520-876a-46eb-86e7-398faca31d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1420877474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d56d598-4dc8-4a2d-972f-f356efba5abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:50Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c50aa8-8277-419d-ae33-262017f29422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c50aa8-8277-419d-ae33-262017f29422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e928bc-4e7e-43e0-a20f-6d0b549455c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e928bc-4e7e-43e0-a20f-6d0b549455c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d56d598-4dc8-4a2d-972f-f356efba5abf', 'volume_name': 'volume-7d56d598-4dc8-4a2d-972f-f356efba5abf', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd872f6-4015-41d9-b48a-ba36faaa9123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd872f6-4015-41d9-b48a-ba36faaa9123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df9ece3-0433-4673-b2fa-223df2eec082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:50 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume 7d56d598-4dc8-4a2d-972f-f356efba5abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d56d598-4dc8-4a2d-972f-f356efba5abf', 'volume_size': 1} Aug 28 08:54:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:51 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (33e83e22-2ed1-40ee-90e5-c9ae27dd7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467732cc-54dc-4111-976c-3f92c9b9463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd" returned: 0 in 1.216s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467732cc-54dc-4111-976c-3f92c9b9463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-22918564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4817a15-1727-4422-8040-e2399f631839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:51Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72e1d38-fec7-416c-b6fc-22d577b0c478),volume_type_id=e72e1d38-fec7-416c-b6fc-22d577b0c478)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5e265-f533-47a6-80d0-4467d3c82781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5e265-f533-47a6-80d0-4467d3c82781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa059728-a632-4064-9b61-03a5c134b0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa059728-a632-4064-9b61-03a5c134b0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4817a15-1727-4422-8040-e2399f631839', 'volume_name': 'volume-c4817a15-1727-4422-8040-e2399f631839', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8d45-4070-4ccb-a86c-35bfdbe65452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ea8d45-4070-4ccb-a86c-35bfdbe65452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e9e3c0-7803-4c78-a9a4-65fc6a10393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Volume c4817a15-1727-4422-8040-e2399f631839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4817a15-1727-4422-8040-e2399f631839', 'volume_size': 1} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:51 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info Aug 28 08:54:51 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (165d8c36-c84f-4c5e-b769-8188e4a83717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de03494-ffdb-49ca-954b-77b0841b9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de03494-ffdb-49ca-954b-77b0841b9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082951436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3203a97-1c82-40d7-9f24-8f2937686fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:52Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bc3096-d961-4e35-b9e3-2fb7e4e422f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bc3096-d961-4e35-b9e3-2fb7e4e422f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c97eeb-0d8b-4fcf-86ba-e6064f6ecda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c97eeb-0d8b-4fcf-86ba-e6064f6ecda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3203a97-1c82-40d7-9f24-8f2937686fae', 'volume_name': 'volume-a3203a97-1c82-40d7-9f24-8f2937686fae', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd27a6c6-8f2e-414f-9b94-aa3d3e23ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd27a6c6-8f2e-414f-9b94-aa3d3e23ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc482fd2-bad4-4078-9c0e-ea7dcd5da2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:51 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume a3203a97-1c82-40d7-9f24-8f2937686fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3203a97-1c82-40d7-9f24-8f2937686fae', 'volume_size': 1} Aug 28 08:54:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:52 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info" returned: 0 in 0.720s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:52 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info is being set with open permissions: ugo+rw Aug 28 08:54:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:52 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info Aug 28 08:54:52 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:53 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.info" returned: 0 in 0.803s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.263s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.693s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1420877474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d56d598-4dc8-4a2d-972f-f356efba5abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:50Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume 7d56d598-4dc8-4a2d-972f-f356efba5abf {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:53 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:53 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf 1073741824 Aug 28 08:54:53 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (974a03dc-2c3e-4ef4-9d7a-61acc48b0b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0828d2-e31c-4c26-a4c9-b7fbcf76c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:53 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b1290cc3-2c47-430d-958f-c8bd7b4fc794 tempest-CinderUnicodeTest-364679869 None] Create snapshot completed successfully Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0828d2-e31c-4c26-a4c9-b7fbcf76c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834475076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd35d14-20a8-42b3-8977-4e04ca029907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:53Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8854e12e-4356-4aaa-9884-490d9d0e0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8854e12e-4356-4aaa-9884-490d9d0e0044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e694c-d5de-4e15-a6a3-e67fabbf9799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e694c-d5de-4e15-a6a3-e67fabbf9799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd35d14-20a8-42b3-8977-4e04ca029907', 'volume_name': 'volume-ebd35d14-20a8-42b3-8977-4e04ca029907', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e4a29-8b95-4077-a714-ba821cb7851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0e4a29-8b95-4077-a714-ba821cb7851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c3bad8-7f12-46fc-83cf-c9800ce76a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:53 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume ebd35d14-20a8-42b3-8977-4e04ca029907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd35d14-20a8-42b3-8977-4e04ca029907', 'volume_size': 1} Aug 28 08:54:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-86171b24-0574-4778-9a83-8645a9b73abd-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-86171b24-0574-4778-9a83-8645a9b73abd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (03ed8cdf-0ecf-4c1c-af98-3bffa6fd0db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647dc424-3c3c-48c2-a2b8-063a9b20dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" acquired by "delete_snapshot" :: waited 0.117s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-quobyte-86171b24-0574-4778-9a83-8645a9b73abd" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-86171b24-0574-4778-9a83-8645a9b73abd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Deleting offline snapshot 86171b24-0574-4778-9a83-8645a9b73abd of volume 32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] snapshot_file for this snap is: volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:54:54 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647dc424-3c3c-48c2-a2b8-063a9b20dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-414779382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d8d2ef-3793-4ad3-99ba-a01013b216fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:54Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6b82e48-42f6-4de5-8a88-37d747e3c8b2),volume_type_id=a6b82e48-42f6-4de5-8a88-37d747e3c8b2)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b82fb5-593b-4a86-bd68-385163a791b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b82fb5-593b-4a86-bd68-385163a791b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6095e9-239d-4741-8865-b2d8fc16e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6095e9-239d-4741-8865-b2d8fc16e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d8d2ef-3793-4ad3-99ba-a01013b216fb', 'volume_name': 'volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3388e5-2e6e-42c1-991e-afef7fc54d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3388e5-2e6e-42c1-991e-afef7fc54d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e5c804-4d09-44cd-99a3-55a9018102ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:54 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Volume e8d8d2ef-3793-4ad3-99ba-a01013b216fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb', 'volume_size': 1} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4c73b-75c1-490c-bfde-e60a22469a95]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf 1073741824" returned: 0 in 1.539s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:55 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf Aug 28 08:54:55 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:55 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd Aug 28 08:54:55 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (ee05f9be-2ef4-484e-816c-f6a4324a849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce80ed25-9659-4e1c-939a-84eaa25785d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (31a30d70-6601-440a-87b4-d2dabb3fcec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df55e5-a374-4120-bebb-00bfa1a60fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df55e5-a374-4120-bebb-00bfa1a60fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982140761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503b5287-bc23-45e1-8411-bbc29597f4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fe8e0a-e86c-4c99-aabf-aa32832779f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fe8e0a-e86c-4c99-aabf-aa32832779f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc26126-7299-419c-bb26-93fe7d452937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc26126-7299-419c-bb26-93fe7d452937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503b5287-bc23-45e1-8411-bbc29597f4df', 'volume_name': 'volume-503b5287-bc23-45e1-8411-bbc29597f4df', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1250e743-b8f7-4cf9-a5c3-c6f51508b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1250e743-b8f7-4cf9-a5c3-c6f51508b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36d7ecf-f603-44d9-8ed3-081ae0024d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume 503b5287-bc23-45e1-8411-bbc29597f4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503b5287-bc23-45e1-8411-bbc29597f4df', 'volume_size': 1} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce80ed25-9659-4e1c-939a-84eaa25785d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285507366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4916392c-4449-49e6-9a89-6c95a4b795db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd81677c-9106-46ef-99d6-1c173d6ac5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd81677c-9106-46ef-99d6-1c173d6ac5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af29bef2-1366-4ed9-9c97-b4b41f5ceacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af29bef2-1366-4ed9-9c97-b4b41f5ceacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4916392c-4449-49e6-9a89-6c95a4b795db', 'volume_name': 'volume-4916392c-4449-49e6-9a89-6c95a4b795db', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f5e33-0b7e-417d-bc44-7e7b782da7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09f5e33-0b7e-417d-bc44-7e7b782da7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dfab04-e3ba-4f71-8327-923e649272b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume 4916392c-4449-49e6-9a89-6c95a4b795db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4916392c-4449-49e6-9a89-6c95a4b795db', 'volume_size': 1} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf" returned: 0 in 0.622s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.040s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-22918564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4817a15-1727-4422-8040-e2399f631839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:51Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72e1d38-fec7-416c-b6fc-22d577b0c478),volume_type_id=e72e1d38-fec7-416c-b6fc-22d577b0c478)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Creating volume c4817a15-1727-4422-8040-e2399f631839 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:55 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:55 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df9ece3-0433-4673-b2fa-223df2eec082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d56d598-4dc8-4a2d-972f-f356efba5abf', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7130f29-ad3a-4ea2-83dc-0c8e58c9ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd" returned: 0 in 0.823s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b3a26c-8f68-426b-bcc6-68af0e914289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:54:55 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 1073741824 Aug 28 08:54:55 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (6dcecc17-629a-468d-8b0b-61fb72b518ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3089af9-ee3a-4965-af59-b4cdcd1fd74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[37291bbd-d03c-4847-9122-0faee08685b9]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-7d56d598-4dc8-4a2d-972f-f356efba5abf (7d56d598-4dc8-4a2d-972f-f356efba5abf): created successfully Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7130f29-ad3a-4ea2-83dc-0c8e58c9ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (ef026839-42d3-4e61-b738-64f9a7807a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3089af9-ee3a-4965-af59-b4cdcd1fd74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295075882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d262bc-57df-4324-9e39-a7a11fb33b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a92d1f6a-6e0e-466c-8eaa-d5a8f9eb4d82),volume_type_id=a92d1f6a-6e0e-466c-8eaa-d5a8f9eb4d82)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57db9742-46a7-4607-9cf0-06c08eb09a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57db9742-46a7-4607-9cf0-06c08eb09a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ac71ea-b4fc-4934-b8b9-9c0f612d7223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:55 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 08:54:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-96fd16be-4596-487e-87cd-5dfd07021407 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:54:56 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 Aug 28 08:54:56 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:56 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ac71ea-b4fc-4934-b8b9-9c0f612d7223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87d262bc-57df-4324-9e39-a7a11fb33b17', 'volume_name': 'volume-87d262bc-57df-4324-9e39-a7a11fb33b17', 'volume_size': 1, 'image_id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800635113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed476ff758944cadae0579e20d1028c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'created_at': datetime.datetime(2026, 8, 28, 6, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a473b40c-c02a-4aa6-bb56-3ddc96a5c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a473b40c-c02a-4aa6-bb56-3ddc96a5c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692c8e29-14f2-4412-922f-fb2f19040a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:56 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Volume 87d262bc-57df-4324-9e39-a7a11fb33b17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87d262bc-57df-4324-9e39-a7a11fb33b17', 'volume_size': 1, 'image_id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800635113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed476ff758944cadae0579e20d1028c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'created_at': datetime.datetime(2026, 8, 28, 6, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe/file', 'properties': {}}, 'image_service': } Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Trying to clone 87d262bc-57df-4324-9e39-a7a11fb33b17 from image 4b95d28b-95f1-48b3-8907-06f7cf543fbe at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 1073741824" returned: 0 in 0.909s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:56 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289" returned: 0 in 0.814s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:56 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd Aug 28 08:54:56 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:56 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 Aug 28 08:54:56 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:57 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839" returned: 0 in 0.426s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.152s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2082951436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3203a97-1c82-40d7-9f24-8f2937686fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:52Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume a3203a97-1c82-40d7-9f24-8f2937686fae {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:57 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:57 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae 1073741824 Aug 28 08:54:57 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e9e3c0-7803-4c78-a9a4-65fc6a10393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4817a15-1727-4422-8040-e2399f631839', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1489ef3-77c4-48ea-9cff-50d753148cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:57 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Volume volume-c4817a15-1727-4422-8040-e2399f631839 (c4817a15-1727-4422-8040-e2399f631839): created successfully Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1489ef3-77c4-48ea-9cff-50d753148cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (33e83e22-2ed1-40ee-90e5-c9ae27dd7c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-48af5428-5693-4246-989f-390be946d10d tempest-TestInstancesWithCinderVolumes-8290971 None] Created volume successfully. Aug 28 08:54:57 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd" returned: 0 in 0.776s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:57 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd Aug 28 08:54:57 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:58 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:58 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289.86171b24-0574-4778-9a83-8645a9b73abd" returned: 0 in 0.676s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae 1073741824" returned: 0 in 0.999s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-86171b24-0574-4778-9a83-8645a9b73abd" released by "_delete_snapshot" :: held 3.522s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" released by "delete_snapshot" :: held 3.597s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:58 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae Aug 28 08:54:58 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Created reservations ['d7b5c31a-9c91-4b1c-bf38-8910c3ad01f0', '2559213e-6502-4245-993c-49eedfcc3992', 'b407079b-9215-4a36-91da-096beddda51c', '1c5b57eb-3d18-4352-a646-3d4fb2831273'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:54:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Delete snapshot completed successfully. Aug 28 08:54:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac618e17-8e9a-492e-ab3f-9264f7e97369 tempest-CinderUnicodeTest-364679869 None] Lock "cinder-86171b24-0574-4778-9a83-8645a9b73abd-delete_snapshot" released by "delete_snapshot" :: held 4.453s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:54:59 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-32b3a26c-8f68-426b-bcc6-68af0e914289-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae" returned: 0 in 0.864s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.297s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834475076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd35d14-20a8-42b3-8977-4e04ca029907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:53Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume ebd35d14-20a8-42b3-8977-4e04ca029907 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:54:59 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:59 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 1073741824 Aug 28 08:54:59 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "cinder-32b3a26c-8f68-426b-bcc6-68af0e914289-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc482fd2-bad4-4078-9c0e-ea7dcd5da2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3203a97-1c82-40d7-9f24-8f2937686fae', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c09102e-5690-41c0-9962-3f314235606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:54:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-a3203a97-1c82-40d7-9f24-8f2937686fae (a3203a97-1c82-40d7-9f24-8f2937686fae): created successfully Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c09102e-5690-41c0-9962-3f314235606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (165d8c36-c84f-4c5e-b769-8188e4a83717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:54:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8efab844-eafd-4621-9cb0-0eeb4a33f41a tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e8463-32d1-4616-ad76-9a0a252719f9]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:54:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:54:59 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 Aug 28 08:54:59 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:00 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 1073741824" returned: 0 in 0.829s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:00 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 Aug 28 08:55:00 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:00 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289" returned: 0 in 0.739s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:00 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289 Aug 28 08:55:00 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:00 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907" returned: 0 in 0.475s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.800s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-414779382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d8d2ef-3793-4ad3-99ba-a01013b216fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:54Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6b82e48-42f6-4de5-8a88-37d747e3c8b2),volume_type_id=a6b82e48-42f6-4de5-8a88-37d747e3c8b2)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Creating volume e8d8d2ef-3793-4ad3-99ba-a01013b216fb {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c3bad8-7f12-46fc-83cf-c9800ce76a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd35d14-20a8-42b3-8977-4e04ca029907', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:00 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb 1073741824 Aug 28 08:55:00 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c97412c-cc21-438b-a85b-8eee43fac5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-ebd35d14-20a8-42b3-8977-4e04ca029907 (ebd35d14-20a8-42b3-8977-4e04ca029907): created successfully Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c97412c-cc21-438b-a85b-8eee43fac5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (974a03dc-2c3e-4ef4-9d7a-61acc48b0b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f62ab0ae-7da4-471a-a552-700b7334fcd0 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:55:00 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-32b3a26c-8f68-426b-bcc6-68af0e914289" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-32b3a26c-8f68-426b-bcc6-68af0e914289" released by "delete_volume" :: held 1.338s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Created reservations ['f753ea47-f5f0-4edb-aa17-c0c9f4f0f2d4', 'cfc545dc-29fb-4546-9cc7-77e570d11f70', 'ffc238ed-18c3-4f64-b648-cc18bf98314c', '677df120-b51e-4481-a185-c1523c4873ac'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:01 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:01 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:01 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb 1073741824" returned: 0 in 0.962s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:01 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.612s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:01 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb Aug 28 08:55:01 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Deleted volume successfully. Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9285355-973e-4a29-abff-76f377ff270f tempest-CinderUnicodeTest-364679869 None] Lock "cinder-32b3a26c-8f68-426b-bcc6-68af0e914289-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-7cfedc01-b212-4d37-aae2-5f70b28423d0-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "cinder-7cfedc01-b212-4d37-aae2-5f70b28423d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Acquiring lock "cinder-quobyte-7cfedc01-b212-4d37-aae2-5f70b28423d0" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-7cfedc01-b212-4d37-aae2-5f70b28423d0" acquired by "delete_volume" :: waited 0.032s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db8172-5443-4b12-a4ac-7fdadcfa74a3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:02 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 Aug 28 08:55:02 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:02 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" returned: 0 in 0.664s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.933s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982140761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503b5287-bc23-45e1-8411-bbc29597f4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume 503b5287-bc23-45e1-8411-bbc29597f4df {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:02 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e5c804-4d09-44cd-99a3-55a9018102ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d62fa9-901a-4bfd-b49b-12ab5ba6f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:02 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df 1073741824 Aug 28 08:55:02 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Volume volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb (e8d8d2ef-3793-4ad3-99ba-a01013b216fb): created successfully Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d62fa9-901a-4bfd-b49b-12ab5ba6f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (03ed8cdf-0ecf-4c1c-af98-3bffa6fd0db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b1ac5f92-36af-4f9f-bd8c-86c3a655fcec tempest-TestInstancesWithCinderVolumes-8290971 None] Created volume successfully. Aug 28 08:55:02 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0" returned: 0 in 0.860s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:03 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0 Aug 28 08:55:03 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:03 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df 1073741824" returned: 0 in 1.093s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:03 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7cfedc01-b212-4d37-aae2-5f70b28423d0" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "cinder-quobyte-7cfedc01-b212-4d37-aae2-5f70b28423d0" released by "delete_volume" :: held 1.517s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:03 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df Aug 28 08:55:03 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Created reservations ['ec82c6b8-8df9-4f68-81e1-ae963ddcd013', 'd727bcc7-3e9f-4f29-9785-b08888972574', 'ebb5d6c3-cee3-408d-ad65-6b4750ad7a92', '306b3606-0bac-4f72-b4e5-af2f9a739dff'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:03 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:03 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:04 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df" returned: 0 in 0.491s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.525s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285507366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4916392c-4449-49e6-9a89-6c95a4b795db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7862ae6510f4c1ca941e989b3bfb594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='791905dfd405479ea507abc87d9c744e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Creating volume 4916392c-4449-49e6-9a89-6c95a4b795db {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:04 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:04 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db 1073741824 Aug 28 08:55:04 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36d7ecf-f603-44d9-8ed3-081ae0024d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503b5287-bc23-45e1-8411-bbc29597f4df', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2e23d3-182d-4ff7-be0c-c59ca13c9533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:04 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-503b5287-bc23-45e1-8411-bbc29597f4df (503b5287-bc23-45e1-8411-bbc29597f4df): created successfully Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2e23d3-182d-4ff7-be0c-c59ca13c9533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (31a30d70-6601-440a-87b4-d2dabb3fcec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ddf21c6b-4d5c-4157-bc8c-fcda672b3726 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:55:04 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.528s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Deleted volume successfully. Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e48dedc-7372-4c3d-ac8b-5aa006e8938d tempest-CinderUnicodeTest-364679869 None] Lock "cinder-7cfedc01-b212-4d37-aae2-5f70b28423d0-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:04 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db 1073741824" returned: 0 in 0.842s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:05 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db Aug 28 08:55:05 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:05 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dfab04-e3ba-4f71-8327-923e649272b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4916392c-4449-49e6-9a89-6c95a4b795db', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc84d0b-760f-438c-8d75-daf02ce5779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Volume volume-4916392c-4449-49e6-9a89-6c95a4b795db (4916392c-4449-49e6-9a89-6c95a4b795db): created successfully Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc84d0b-760f-438c-8d75-daf02ce5779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Flow 'volume_create_manager' (ee05f9be-2ef4-484e-816c-f6a4324a849c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0122b237-839a-41ab-acbb-eb6b44235899 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created volume successfully. Aug 28 08:55:05 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD, size 20.69 MB, duration 9.47 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 08:55:05 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Image download 20.69 MB at 2.18 MB/s Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c969afa-830a-4374-90d9-ff178e65085f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:06 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD Aug 28 08:55:06 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:06 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-503b5287-bc23-45e1-8411-bbc29597f4df-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Temporary image 4b95d28b-95f1-48b3-8907-06f7cf543fbe is fetched for user 80a5658d238c4c6f98a181b838bea1ec. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 08:55:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-503b5287-bc23-45e1-8411-bbc29597f4df-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-503b5287-bc23-45e1-8411-bbc29597f4df" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-503b5287-bc23-45e1-8411-bbc29597f4df" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[84adcef0-2a4a-423b-8941-10c3ff5a2edd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf171dd-ba25-49fc-b91c-9c859717cc0b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Flow 'volume_create_manager' (4bdb5fb1-5300-49b0-b230-dd06daec348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ebf21-9aa4-4599-ab6c-6014bdc3ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ebf21-9aa4-4599-ab6c-6014bdc3ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-17804373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f2df8f-ae91-423e-a28f-a486ba2fdab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5e52ae38f47a9bd0a68af1de2d990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:07Z,use_quota=True,user_id='b9fca30c19884e7683c1de2a756ee9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c18c10a-a67b-4b9c-865b-54f80d0dab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c18c10a-a67b-4b9c-865b-54f80d0dab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f346fafa-0637-4e64-9701-9d3b3e483e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f346fafa-0637-4e64-9701-9d3b3e483e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f2df8f-ae91-423e-a28f-a486ba2fdab3', 'volume_name': 'volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d2e3b-a8f6-4554-8d46-688d202c1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d2e3b-a8f6-4554-8d46-688d202c1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51848e7-59e6-42e7-ab0b-a7b987eabf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:07 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Volume e3f2df8f-ae91-423e-a28f-a486ba2fdab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3', 'volume_size': 1} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:07 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:07 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-17804373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f2df8f-ae91-423e-a28f-a486ba2fdab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5e52ae38f47a9bd0a68af1de2d990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:07Z,use_quota=True,user_id='b9fca30c19884e7683c1de2a756ee9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Creating volume e3f2df8f-ae91-423e-a28f-a486ba2fdab3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:07 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df Aug 28 08:55:07 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:07 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:07 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 1073741824 Aug 28 08:55:07 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:07 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df" returned: 0 in 0.629s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:07 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df Aug 28 08:55:07 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:07 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:08 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-503b5287-bc23-45e1-8411-bbc29597f4df" returned: 0 in 0.370s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-503b5287-bc23-45e1-8411-bbc29597f4df" released by "delete_volume" :: held 1.063s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:08 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 1073741824" returned: 0 in 0.758s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['b58ca740-472c-4f24-84bc-bfe717f06b37', 'c8e43178-b2f7-45d9-88db-04369b87e353', '2ea047e8-a348-4c28-8230-2da4dc44ea2d', '7e41e1a5-d46f-49a3-8ae4-af9af9f6cb01'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:08 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 Aug 28 08:55:08 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:08 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:08 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:08 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295075882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d262bc-57df-4324-9e39-a7a11fb33b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed476ff758944cadae0579e20d1028c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:54:55Z,use_quota=True,user_id='80a5658d238c4c6f98a181b838bea1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a92d1f6a-6e0e-466c-8eaa-d5a8f9eb4d82),volume_type_id=a92d1f6a-6e0e-466c-8eaa-d5a8f9eb4d82)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Creating volume 87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:08 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51848e7-59e6-42e7-ab0b-a7b987eabf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:08 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1073741824 Aug 28 08:55:08 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b42e893-d9fc-4202-a852-77c6f84859f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:08 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Volume volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 (e3f2df8f-ae91-423e-a28f-a486ba2fdab3): created successfully Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b42e893-d9fc-4202-a852-77c6f84859f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Flow 'volume_create_manager' (4bdb5fb1-5300-49b0-b230-dd06daec348c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:08 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.356s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2e1f6ce8-81a4-41a5-83e6-ee765e57e26b tempest-ServersNegativeTestJSON-1327212555 None] Created volume successfully. Aug 28 08:55:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a35bffe3-04b0-4e5a-9e0e-bb4aa951e926 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-503b5287-bc23-45e1-8411-bbc29597f4df-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:09 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1073741824" returned: 0 in 0.668s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-4916392c-4449-49e6-9a89-6c95a4b795db-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-4916392c-4449-49e6-9a89-6c95a4b795db-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:09 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 Aug 28 08:55:09 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-4916392c-4449-49e6-9a89-6c95a4b795db" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-4916392c-4449-49e6-9a89-6c95a4b795db" acquired by "delete_volume" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[055482f5-8323-4c5f-922f-897769b4bdc5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:09 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db Aug 28 08:55:09 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:09 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Attempting download of 4b95d28b-95f1-48b3-8907-06f7cf543fbe ((None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}])) to volume 87d262bc-57df-4324-9e39-a7a11fb33b17. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df495c0-c667-46a7-a258-f78c01fcefa3]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:10 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:10 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db Aug 28 08:55:10 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:10 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw Aug 28 08:55:10 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:10 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4916392c-4449-49e6-9a89-6c95a4b795db" returned: 0 in 0.428s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-4916392c-4449-49e6-9a89-6c95a4b795db" released by "delete_volume" :: held 1.075s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:10 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw" returned: 0 in 0.660s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['e7b6caff-8f99-4696-b0f4-f639fb52c79f', '78749b15-560b-46f8-bdef-ab3af2226e08', 'd94ccc82-0110-41d1-a1bf-8d801296511e', 'fe1d0200-e18c-435e-8883-4f8db52e79dd'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:10 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw Aug 28 08:55:10 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:10 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:10 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:11 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw" returned: 1 in 0.712s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b95d28b-95f1-48b3-8907-06f7cf543fbe_vmjniykw' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[931af13a-468b-4399-92c8-c21eedc785a7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:11 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.526s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:11 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-405f868e-4633-44d9-b05c-33497825c17e tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-4916392c-4449-49e6-9a89-6c95a4b795db-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-ebd35d14-20a8-42b3-8977-4e04ca029907-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:11 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD Aug 28 08:55:11 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-ebd35d14-20a8-42b3-8977-4e04ca029907-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Flow 'volume_create_manager' (41f67b25-b699-4f1a-b0a5-618f0b103823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75b9202-9b31-49c6-8fe3-9a0f3c52e5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-ebd35d14-20a8-42b3-8977-4e04ca029907" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75b9202-9b31-49c6-8fe3-9a0f3c52e5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1405596208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fc6bd-8339-4e37-a71c-0b9d41c47454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5e52ae38f47a9bd0a68af1de2d990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:11Z,use_quota=True,user_id='b9fca30c19884e7683c1de2a756ee9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719f858a-3c5c-439e-a437-731405844945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719f858a-3c5c-439e-a437-731405844945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8e49d7-a3fc-4bfc-8e8d-d83df4c92256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8e49d7-a3fc-4bfc-8e8d-d83df4c92256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407fc6bd-8339-4e37-a71c-0b9d41c47454', 'volume_name': 'volume-407fc6bd-8339-4e37-a71c-0b9d41c47454', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a79250-b68e-47e0-9d9f-75c8bcab890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a79250-b68e-47e0-9d9f-75c8bcab890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5e6e80-67c4-4466-9dd2-e405d2ea4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Volume 407fc6bd-8339-4e37-a71c-0b9d41c47454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407fc6bd-8339-4e37-a71c-0b9d41c47454', 'volume_size': 1} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1405596208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fc6bd-8339-4e37-a71c-0b9d41c47454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5e52ae38f47a9bd0a68af1de2d990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:11Z,use_quota=True,user_id='b9fca30c19884e7683c1de2a756ee9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Creating volume 407fc6bd-8339-4e37-a71c-0b9d41c47454 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:11 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] 4b95d28b-95f1-48b3-8907-06f7cf543fbe was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 08:55:11 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 1073741824 Aug 28 08:55:11 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-ebd35d14-20a8-42b3-8977-4e04ca029907" acquired by "delete_volume" :: waited 0.134s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:11 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 Aug 28 08:55:11 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cec9eb-ad56-471b-b502-3f17f8ce4470]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Flow 'volume_create_manager' (3a77e646-f50e-4c5e-b91d-c11a3b416c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a5b538-c641-4e4c-a9b8-6f064de96f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a5b538-c641-4e4c-a9b8-6f064de96f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64682815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087d309c-996b-4152-b95c-782fefd767be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8250db12b3a747dea96da3c35731ac0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:12Z,use_quota=True,user_id='b907096041284b718f4079f1942864dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c09886-6d26-4977-883d-c65c4728adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c09886-6d26-4977-883d-c65c4728adc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4dbaf-91f3-46d3-8fab-700d8672c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4dbaf-91f3-46d3-8fab-700d8672c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087d309c-996b-4152-b95c-782fefd767be', 'volume_name': 'volume-087d309c-996b-4152-b95c-782fefd767be', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb6e660-0880-4332-9e0d-08a9cdb59c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb6e660-0880-4332-9e0d-08a9cdb59c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd403df7-01fa-4657-8d55-3b695e19e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:12 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Volume 087d309c-996b-4152-b95c-782fefd767be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087d309c-996b-4152-b95c-782fefd767be', 'volume_size': 1} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:12 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 Aug 28 08:55:12 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:12 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907" returned: 0 in 0.565s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:12 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 1073741824" returned: 0 in 0.694s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:12 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907 Aug 28 08:55:12 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:12 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 Aug 28 08:55:12 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:12 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:12 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454" returned: 0 in 0.345s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64682815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087d309c-996b-4152-b95c-782fefd767be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8250db12b3a747dea96da3c35731ac0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:12Z,use_quota=True,user_id='b907096041284b718f4079f1942864dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Creating volume 087d309c-996b-4152-b95c-782fefd767be {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:12 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebd35d14-20a8-42b3-8977-4e04ca029907" returned: 0 in 0.459s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:12 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be 1073741824 Aug 28 08:55:12 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-ebd35d14-20a8-42b3-8977-4e04ca029907" released by "delete_volume" :: held 1.106s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5e6e80-67c4-4466-9dd2-e405d2ea4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407fc6bd-8339-4e37-a71c-0b9d41c47454', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8cfd25-0a81-4663-8943-da780e0537f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:12 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Volume volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 (407fc6bd-8339-4e37-a71c-0b9d41c47454): created successfully Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8cfd25-0a81-4663-8943-da780e0537f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Flow 'volume_create_manager' (41f67b25-b699-4f1a-b0a5-618f0b103823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4c019ad7-7e59-4398-bcdc-be32ab6f1a6f tempest-ServersNegativeTestJSON-1327212555 None] Created volume successfully. Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['40db1032-6b8c-4656-9f14-822695289078', '5530c6aa-bc2a-41f7-8d2c-9c30a6ce34ea', '49d4d185-1ff0-43ba-b7cf-36bbcd0f6c70', '542aea27-6e18-4ae0-a0cf-8390804a306e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:13 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:13 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:13 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be 1073741824" returned: 0 in 0.624s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:13 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.316s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eafbb080-e70c-49b9-8d9d-2f08a47103c4 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-ebd35d14-20a8-42b3-8977-4e04ca029907-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:13 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be Aug 28 08:55:13 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-a3203a97-1c82-40d7-9f24-8f2937686fae-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-a3203a97-1c82-40d7-9f24-8f2937686fae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-a3203a97-1c82-40d7-9f24-8f2937686fae" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-a3203a97-1c82-40d7-9f24-8f2937686fae" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c778654-fd9f-4066-9edb-f70c36eeab6c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:13 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd403df7-01fa-4657-8d55-3b695e19e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087d309c-996b-4152-b95c-782fefd767be', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eada4606-9436-4e8c-b851-0211b5b83687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Volume volume-087d309c-996b-4152-b95c-782fefd767be (087d309c-996b-4152-b95c-782fefd767be): created successfully Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eada4606-9436-4e8c-b851-0211b5b83687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Flow 'volume_create_manager' (3a77e646-f50e-4c5e-b91d-c11a3b416c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ba94c92d-236d-4a0d-aa7b-7729539ebd1e tempest-ProjectReaderTests-2145803702 None] Created volume successfully. Aug 28 08:55:14 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae Aug 28 08:55:14 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:14 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17" returned: 0 in 2.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b95d28b-95f1-48b3-8907-06f7cf543fbe_di2rgb0ydevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:55:14 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Converted 112.00 MB image at 46.69 MB/s Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "cinder-407fc6bd-8339-4e37-a71c-0b9d41c47454-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:14 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1G Aug 28 08:55:14 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-407fc6bd-8339-4e37-a71c-0b9d41c47454-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "cinder-quobyte-407fc6bd-8339-4e37-a71c-0b9d41c47454" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-quobyte-407fc6bd-8339-4e37-a71c-0b9d41c47454" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddbc93-fff3-4e21-a87e-8bdffa270f14]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:14 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae" returned: 0 in 0.515s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:14 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae Aug 28 08:55:14 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:14 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 Aug 28 08:55:14 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:14 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 1G" returned: 0 in 0.459s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Downloaded image 4b95d28b-95f1-48b3-8907-06f7cf543fbe ((None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}])) to volume 87d262bc-57df-4324-9e39-a7a11fb33b17 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Temporary image 4b95d28b-95f1-48b3-8907-06f7cf543fbe for user 80a5658d238c4c6f98a181b838bea1ec is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Marking volume 87d262bc-57df-4324-9e39-a7a11fb33b17 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Copying metadata from image 4b95d28b-95f1-48b3-8907-06f7cf543fbe to 87d262bc-57df-4324-9e39-a7a11fb33b17. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Creating volume glance metadata for volume 87d262bc-57df-4324-9e39-a7a11fb33b17 backed by image 4b95d28b-95f1-48b3-8907-06f7cf543fbe with: {'image_id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'image_name': 'tempest-scenario-img--1800635113', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692c8e29-14f2-4412-922f-fb2f19040a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d262bc-57df-4324-9e39-a7a11fb33b17', 'volume_size': 1, 'image_id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1800635113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed476ff758944cadae0579e20d1028c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b95d28b-95f1-48b3-8907-06f7cf543fbe', 'created_at': datetime.datetime(2026, 8, 28, 6, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b95d28b-95f1-48b3-8907-06f7cf543fbe/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d650671-b1c0-407e-992e-2e805492bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:14 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a3203a97-1c82-40d7-9f24-8f2937686fae" returned: 0 in 0.354s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Volume volume-87d262bc-57df-4324-9e39-a7a11fb33b17 (87d262bc-57df-4324-9e39-a7a11fb33b17): created successfully Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d650671-b1c0-407e-992e-2e805492bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Flow 'volume_create_manager' (6dcecc17-629a-468d-8b0b-61fb72b518ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-a3203a97-1c82-40d7-9f24-8f2937686fae" released by "delete_volume" :: held 0.945s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ce6fc9fc-1be5-4dea-be4a-aacfbca767d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Created volume successfully. Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['4f787336-fbb8-477f-bc4c-88035f27cc97', '728fa6c6-6119-4d7d-848c-57637ec96c6e', '141d9ea4-4b2e-4763-9197-ec3c29f42812', '1083abdc-2d7e-4833-8fff-de29ba77042f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:14 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454" returned: 0 in 0.589s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:15 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454 Aug 28 08:55:15 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "cinder-087d309c-996b-4152-b95c-782fefd767be-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:15 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:15 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-087d309c-996b-4152-b95c-782fefd767be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "cinder-quobyte-087d309c-996b-4152-b95c-782fefd767be" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-quobyte-087d309c-996b-4152-b95c-782fefd767be" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e818575-8097-47c5-908c-69b3ee19087e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:15 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-407fc6bd-8339-4e37-a71c-0b9d41c47454" returned: 0 in 0.412s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-quobyte-407fc6bd-8339-4e37-a71c-0b9d41c47454" released by "delete_volume" :: held 1.074s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:15 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:15 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be Aug 28 08:55:15 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-15f3f9f4-001b-4c5c-8a31-bae614dd8efc tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-a3203a97-1c82-40d7-9f24-8f2937686fae-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Created reservations ['e8da9679-ed4b-4102-beca-ed87ee3c15c5', '7d5ac723-2812-456b-8d34-235eccbed50a', 'd6442712-c692-4f75-ae88-a834031c0549', 'ce4c3620-8ce2-4ae7-8f61-5d620a1de9a8'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:15 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:15 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:15 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be" returned: 0 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:15 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be Aug 28 08:55:15 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:15 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Deleted volume successfully. Aug 28 08:55:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-4ea9df46-4707-4732-a61d-21397dfd5a8c tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-407fc6bd-8339-4e37-a71c-0b9d41c47454-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:16 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-7d56d598-4dc8-4a2d-972f-f356efba5abf-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-087d309c-996b-4152-b95c-782fefd767be" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-quobyte-087d309c-996b-4152-b95c-782fefd767be" released by "delete_volume" :: held 0.900s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-7d56d598-4dc8-4a2d-972f-f356efba5abf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-7d56d598-4dc8-4a2d-972f-f356efba5abf" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-7d56d598-4dc8-4a2d-972f-f356efba5abf" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Created reservations ['c941344b-4216-4746-a18d-605eb0368e53', '99b399f3-89f2-4786-97a5-e3dba6d3ea16', '5cb1d26c-27b2-4612-9216-23a01fca17c9', 'baaaaf7b-7793-4da0-842a-3c7ea9f791da'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[eada080b-a624-4d87-88d2-19812b5d73cc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:16 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:16 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:16 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf Aug 28 08:55:16 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "cinder-e3f2df8f-ae91-423e-a28f-a486ba2fdab3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-e3f2df8f-ae91-423e-a28f-a486ba2fdab3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "cinder-quobyte-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-quobyte-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7793eaad-f750-48ab-b281-f5adec5a4100]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:16 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.338s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Deleted volume successfully. Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-76c76000-9012-4dfc-9dfb-722e3debc854 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-087d309c-996b-4152-b95c-782fefd767be-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:16 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:16 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 Aug 28 08:55:16 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:16 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf Aug 28 08:55:16 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:17 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7d56d598-4dc8-4a2d-972f-f356efba5abf" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-7d56d598-4dc8-4a2d-972f-f356efba5abf" released by "delete_volume" :: held 0.957s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:17 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" returned: 0 in 0.561s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:17 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3 Aug 28 08:55:17 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['a56863f9-aa4c-4c49-8760-9a75a7d3e3ef', '002a017b-1e78-4a66-a604-9f6135a4ba96', 'bc7878b1-299e-4267-89a7-5652686ec751', '8a88c294-6541-4053-ad03-75096cec0e63'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:17 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:17 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:17 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" returned: 0 in 0.436s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-quobyte-e3f2df8f-ae91-423e-a28f-a486ba2fdab3" released by "delete_volume" :: held 1.078s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Created reservations ['42501cad-85eb-4988-9750-29431e197f32', '5a0f00c7-ba7d-4400-a496-aa58e6b5cd50', 'c4d0a819-8793-434a-842a-7f4e8ae44912', 'ecf9fd82-0733-4083-9b88-51d8816f4151'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:17 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eccd3ea1-df57-41b4-9d20-92aad54daf04 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-7d56d598-4dc8-4a2d-972f-f356efba5abf-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:18 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:18 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Flow 'volume_create_manager' (5ec898aa-e4e7-4ece-a403-5c3448362df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40140ef6-d08f-42e3-ac68-a54358bb9495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:18 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Deleted volume successfully. Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40140ef6-d08f-42e3-ac68-a54358bb9495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1759525682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30318212-5c4c-49c6-8744-c42fcf3d24d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8250db12b3a747dea96da3c35731ac0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:18Z,use_quota=True,user_id='b907096041284b718f4079f1942864dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53cbd24-5f68-44ce-bb0d-3874d0ad2b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53cbd24-5f68-44ce-bb0d-3874d0ad2b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f06b6c-5821-407d-98f0-e19bcc8941f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f06b6c-5821-407d-98f0-e19bcc8941f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30318212-5c4c-49c6-8744-c42fcf3d24d8', 'volume_name': 'volume-30318212-5c4c-49c6-8744-c42fcf3d24d8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1a51f8-d109-4aa9-b481-2a467dca27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1a51f8-d109-4aa9-b481-2a467dca27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6494e31b-a5dd-4d73-a544-83b46798c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:18 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Volume 30318212-5c4c-49c6-8744-c42fcf3d24d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30318212-5c4c-49c6-8744-c42fcf3d24d8', 'volume_size': 1} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1759525682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30318212-5c4c-49c6-8744-c42fcf3d24d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8250db12b3a747dea96da3c35731ac0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:18Z,use_quota=True,user_id='b907096041284b718f4079f1942864dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Creating volume 30318212-5c4c-49c6-8744-c42fcf3d24d8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:18 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:18 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 1073741824 Aug 28 08:55:18 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a383253f-24cc-4e78-a5c0-492f78624997 tempest-ServersNegativeTestJSON-1327212555 None] Lock "cinder-e3f2df8f-ae91-423e-a28f-a486ba2fdab3-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleting offline snapshot d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf of volume 1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] snapshot_file for this snap is: volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9e6b3-9864-4ed9-b291-b2c6389e7e7e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:18 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf Aug 28 08:55:18 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:19 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" returned: 0 in 0.577s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:19 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 1073741824" returned: 0 in 0.832s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f63168-a93c-43f9-adcd-35def4f8fb12]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:19 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 Aug 28 08:55:19 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:19 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b Aug 28 08:55:19 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e20f2b8a-ea71-4edf-8b63-a37b3a2fca65 req-c5956d37-8216-454a-a94c-6194d795678f tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:20 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8" returned: 0 in 0.618s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e20f2b8a-ea71-4edf-8b63-a37b3a2fca65 req-c5956d37-8216-454a-a94c-6194d795678f tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.429s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6494e31b-a5dd-4d73-a544-83b46798c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30318212-5c4c-49c6-8744-c42fcf3d24d8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:20 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2441df-f2f9-4ad2-a749-02bcc6dee520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-e20f2b8a-ea71-4edf-8b63-a37b3a2fca65 req-c5956d37-8216-454a-a94c-6194d795678f tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.079s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b" returned: 0 in 0.793s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Volume volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 (30318212-5c4c-49c6-8744-c42fcf3d24d8): created successfully Aug 28 08:55:20 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf Aug 28 08:55:20 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2441df-f2f9-4ad2-a749-02bcc6dee520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Flow 'volume_create_manager' (5ec898aa-e4e7-4ece-a403-5c3448362df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a328cc98-2faa-4b15-9b79-70ab6833c227 tempest-ProjectReaderTests-2145803702 None] Created volume successfully. Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-e20f2b8a-ea71-4edf-8b63-a37b3a2fca65 req-c5956d37-8216-454a-a94c-6194d795678f tempest-TestInstancesWithCinderVolumes-8290971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-87d262bc-57df-4324-9e39-a7a11fb33b17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51a28fda-f055-4ecc-9ffa-889c505e1590', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:55:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-e20f2b8a-ea71-4edf-8b63-a37b3a2fca65 req-c5956d37-8216-454a-a94c-6194d795678f tempest-TestInstancesWithCinderVolumes-8290971 None] attachment_update completed successfully. Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "cinder-30318212-5c4c-49c6-8744-c42fcf3d24d8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-30318212-5c4c-49c6-8744-c42fcf3d24d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "cinder-quobyte-30318212-5c4c-49c6-8744-c42fcf3d24d8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-quobyte-30318212-5c4c-49c6-8744-c42fcf3d24d8" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f4025-04d8-4019-863c-bc6b97ba95a6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:20 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 Aug 28 08:55:20 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:20 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" returned: 0 in 0.823s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:21 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf Aug 28 08:55:21 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8" returned: 0 in 0.666s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:21 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8 Aug 28 08:55:21 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:21 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b.d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" returned: 0 in 0.467s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf" released by "_delete_snapshot" :: held 2.882s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" released by "delete_snapshot" :: held 2.914s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['34e831a4-9484-4444-bdac-c1a5aa774886', '61f15ce3-deff-4c71-8ef3-17b9a5f38df6', '713220ab-88d5-48bd-8b9e-fc9e4e2c6498', 'd9106840-1fbe-4a1c-8468-8764ece56397'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:21 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-30318212-5c4c-49c6-8744-c42fcf3d24d8" returned: 0 in 0.354s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-quobyte-30318212-5c4c-49c6-8744-c42fcf3d24d8" released by "delete_volume" :: held 1.112s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Created reservations ['2bb246cd-e9dd-4743-bd9f-745a40178f28', '89013147-eecd-408d-9b28-9dd13a7bb979', 'b62ed920-b1c8-409a-89c2-75ab1c1405b6', 'e627b602-6157-4654-b8ff-71378c72a909'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Delete snapshot completed successfully. Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3610830d-a5b5-4d5f-bcb5-de7c5d56ca23 tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-d2c1d6d6-0ddb-41c8-bfb0-c7469f2bb1cf-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:21 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:21 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:22 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.447s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:22 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Deleted volume successfully. Aug 28 08:55:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe9d55d0-2a96-4b9e-80b9-7ea73c6fe616 tempest-ProjectReaderTests-2145803702 None] Lock "cinder-30318212-5c4c-49c6-8744-c42fcf3d24d8-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-1f6a944a-f6e4-420f-a21d-9a1715556c0b-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-1f6a944a-f6e4-420f-a21d-9a1715556c0b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e44cf69-c42e-479e-bc3e-20e10750c54c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:23 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b Aug 28 08:55:23 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:23 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b" returned: 0 in 0.599s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:23 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b Aug 28 08:55:23 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:24 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1f6a944a-f6e4-420f-a21d-9a1715556c0b" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-quobyte-1f6a944a-f6e4-420f-a21d-9a1715556c0b" released by "delete_volume" :: held 1.141s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Created reservations ['ea50c8ec-1850-4acd-80b0-b60bd70c0edc', 'ebb00d95-c191-4f56-9c3b-efa1c43d695a', '9f173a37-eb6f-4fd7-819d-47bb7f429503', '92e21f5c-23fe-46bf-bf68-b73a628d1314'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:24 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:24 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:24 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.464s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Deleted volume successfully. Aug 28 08:55:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9b98efa7-d003-40cb-bc79-1952a4acf7ff tempest-CreateVolumesFromSnapshotTest-536808378 None] Lock "cinder-1f6a944a-f6e4-420f-a21d-9a1715556c0b-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:34 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=128,cinder:INSERT=49,cinder:UPDATE=171,cinder:DELETE=13 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:55:34 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=121,cinder:INSERT=37,cinder:UPDATE=160,cinder:DELETE=17 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Flow 'volume_create_manager' (1eba9e19-3c0d-42d8-ac05-b9bbafc729cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08618c34-3798-4e84-be60-d1bfc76c987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08618c34-3798-4e84-be60-d1bfc76c987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2155d136-bdfb-4eab-a062-6d775ecce7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3066b8c0d5424480507fa9180f2375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:37Z,use_quota=True,user_id='b6b721a7f2894eef9d49bb6d9fe54ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73732c83-e805-4c7c-b937-f90b48edfadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73732c83-e805-4c7c-b937-f90b48edfadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56679cee-14e6-48f9-bfb2-64497b9b42d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:36 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56679cee-14e6-48f9-bfb2-64497b9b42d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2155d136-bdfb-4eab-a062-6d775ecce7ad', 'volume_name': 'volume-2155d136-bdfb-4eab-a062-6d775ecce7ad', 'volume_size': 1, 'image_id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '322eb7ddcbeb571af1bfe6394560ab30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3066b8c0d5424480507fa9180f2375', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f78244897ac5c68b27703bb258e9d3edb984a02c7ff59e9ecb00d199271b0f8f945d64f4ec7a1662b8a374f6431c0531a5a189776f5008017208897ef4a89986', 'id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'created_at': datetime.datetime(2026, 8, 28, 6, 55, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 55, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde3226f-81bb-426c-b8ae-321547e37940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde3226f-81bb-426c-b8ae-321547e37940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a66376-1c64-4ed8-828e-7a3cb43fff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:37 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Volume 2155d136-bdfb-4eab-a062-6d775ecce7ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2155d136-bdfb-4eab-a062-6d775ecce7ad', 'volume_size': 1, 'image_id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '322eb7ddcbeb571af1bfe6394560ab30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3066b8c0d5424480507fa9180f2375', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f78244897ac5c68b27703bb258e9d3edb984a02c7ff59e9ecb00d199271b0f8f945d64f4ec7a1662b8a374f6431c0531a5a189776f5008017208897ef4a89986', 'id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'created_at': datetime.datetime(2026, 8, 28, 6, 55, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 55, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b/file', 'properties': {}}, 'image_service': } Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Trying to clone 2155d136-bdfb-4eab-a062-6d775ecce7ad from image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b at location (None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 08:55:37 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Image download 0.00 MB at 0.00 MB/s Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23af33e-9809-4b60-a93b-6297d9fddd8f]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:37 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:37 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:38 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:38 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:38 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:39 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:55:39 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Temporary image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b is fetched for user b6b721a7f2894eef9d49bb6d9fe54ec8. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 08:55:39 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc9f0c-6271-4703-97db-9b5de88db740]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:39 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:39 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:40 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:40 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:40 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:40 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:40 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:40 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.532s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:55:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:55:41 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 1 in 0.985s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2155d136-bdfb-4eab-a062-6d775ecce7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3066b8c0d5424480507fa9180f2375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:37Z,use_quota=True,user_id='b6b721a7f2894eef9d49bb6d9fe54ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Creating volume 2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:41 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:41 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1073741824 Aug 28 08:55:41 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:41 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1073741824" returned: 0 in 0.806s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:42 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad Aug 28 08:55:42 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:42 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad" returned: 0 in 0.634s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Attempting download of 65d41c68-5b18-46c8-a3c6-2cf25b1e542b ((None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}])) to volume 2155d136-bdfb-4eab-a062-6d775ecce7ad. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba74e68-1f64-4ad9-ae60-1caff101e528]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:42 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc Aug 28 08:55:42 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:43 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc" returned: 0 in 0.583s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:43 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc Aug 28 08:55:43 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:44 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc" returned: 1 in 0.689s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_sxfaxswc' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf2ce2-f2eb-4e1f-b478-084aea9f6631]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:44 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:44 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:44 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:45 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD Aug 28 08:55:45 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:45 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 08:55:45 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] 65d41c68-5b18-46c8-a3c6-2cf25b1e542b was raw, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 08:55:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:45 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad Aug 28 08:55:45 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:46 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad" returned: 0 in 0.839s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:46 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65d41c68-5b18-46c8-a3c6-2cf25b1e542b_rx7gbtumdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:55:46 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 08:55:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:46 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1G Aug 28 08:55:46 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:47 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad 1G" returned: 0 in 0.758s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Downloaded image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b ((None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}])) to volume 2155d136-bdfb-4eab-a062-6d775ecce7ad successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Temporary image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b for user b6b721a7f2894eef9d49bb6d9fe54ec8 is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Marking volume 2155d136-bdfb-4eab-a062-6d775ecce7ad as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Copying metadata from image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b to 2155d136-bdfb-4eab-a062-6d775ecce7ad. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Creating volume glance metadata for volume 2155d136-bdfb-4eab-a062-6d775ecce7ad backed by image 65d41c68-5b18-46c8-a3c6-2cf25b1e542b with: {'image_id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '322eb7ddcbeb571af1bfe6394560ab30', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a66376-1c64-4ed8-828e-7a3cb43fff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2155d136-bdfb-4eab-a062-6d775ecce7ad', 'volume_size': 1, 'image_id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '322eb7ddcbeb571af1bfe6394560ab30', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3066b8c0d5424480507fa9180f2375', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f78244897ac5c68b27703bb258e9d3edb984a02c7ff59e9ecb00d199271b0f8f945d64f4ec7a1662b8a374f6431c0531a5a189776f5008017208897ef4a89986', 'id': '65d41c68-5b18-46c8-a3c6-2cf25b1e542b', 'created_at': datetime.datetime(2026, 8, 28, 6, 55, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 55, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65d41c68-5b18-46c8-a3c6-2cf25b1e542b/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e1b39-7af7-43de-9e3e-6abffb3e02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Volume volume-2155d136-bdfb-4eab-a062-6d775ecce7ad (2155d136-bdfb-4eab-a062-6d775ecce7ad): created successfully Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e1b39-7af7-43de-9e3e-6abffb3e02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Flow 'volume_create_manager' (1eba9e19-3c0d-42d8-ac05-b9bbafc729cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4ec4fc72-f572-4567-b91e-3233f3fc325f tempest-VolumeImageDependencyTests-2129296386 None] Created volume successfully. Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Acquiring lock "cinder-2155d136-bdfb-4eab-a062-6d775ecce7ad-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "cinder-2155d136-bdfb-4eab-a062-6d775ecce7ad-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Acquiring lock "cinder-quobyte-2155d136-bdfb-4eab-a062-6d775ecce7ad" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "cinder-quobyte-2155d136-bdfb-4eab-a062-6d775ecce7ad" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[837dc09a-e9bf-4cc6-93a4-e1615bfe76fd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:55:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:49 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad Aug 28 08:55:49 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:49 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad" returned: 0 in 0.798s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:49 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad Aug 28 08:55:49 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:50 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2155d136-bdfb-4eab-a062-6d775ecce7ad" returned: 0 in 0.671s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "cinder-quobyte-2155d136-bdfb-4eab-a062-6d775ecce7ad" released by "delete_volume" :: held 1.557s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Created reservations ['04ea53c8-0c43-4347-86b7-bd429558a279', '9fa18b54-a6b9-40d1-92ae-5323956fc823', 'cae98dab-bf80-4972-ab74-7d365d6fca9c', '996cd2b1-fa10-4724-ab7b-f1a79346d836'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:50 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:55:50 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:51 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.390s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:51 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:55:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Deleted volume successfully. Aug 28 08:55:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1fa36833-9eed-4705-997b-1f2d33721009 tempest-VolumeImageDependencyTests-2129296386 None] Lock "cinder-2155d136-bdfb-4eab-a062-6d775ecce7ad-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (ad6438d7-54c7-4e31-8f79-b6ed11a8e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab527689-5b9c-40ec-b223-6ba03065a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab527689-5b9c-40ec-b223-6ba03065a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150681253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac47ca4c-d64c-4572-b708-a24300f92cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:59Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2d65a-347f-46aa-beaf-f3a42e06d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2d65a-347f-46aa-beaf-f3a42e06d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a349b6-e95d-4874-b64e-d31bfa8f1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a349b6-e95d-4874-b64e-d31bfa8f1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac47ca4c-d64c-4572-b708-a24300f92cc2', 'volume_name': 'volume-ac47ca4c-d64c-4572-b708-a24300f92cc2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a84f6c-9151-4587-b869-127d5df44ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a84f6c-9151-4587-b869-127d5df44ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca86493-284b-4162-8ddd-479e8a6598ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:55:58 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Volume ac47ca4c-d64c-4572-b708-a24300f92cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac47ca4c-d64c-4572-b708-a24300f92cc2', 'volume_size': 1} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150681253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac47ca4c-d64c-4572-b708-a24300f92cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:55:59Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Creating volume ac47ca4c-d64c-4572-b708-a24300f92cc2 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:55:58 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:55:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:58 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 1073741824 Aug 28 08:55:58 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:55:59 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Aug 28 08:55:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 1073741824" returned: 0 in 0.683s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:55:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:55:59 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 Aug 28 08:55:59 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:00 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2" returned: 0 in 0.371s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca86493-284b-4162-8ddd-479e8a6598ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac47ca4c-d64c-4572-b708-a24300f92cc2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db8316d-0711-4433-a588-1ea358265c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Volume volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 (ac47ca4c-d64c-4572-b708-a24300f92cc2): created successfully Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db8316d-0711-4433-a588-1ea358265c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (ad6438d7-54c7-4e31-8f79-b6ed11a8e625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9997447d-9443-4589-989e-8e0c13c6a8c2 tempest-ProjectReaderTests-467865855 None] Created volume successfully. Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-ac47ca4c-d64c-4572-b708-a24300f92cc2-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "cinder-ac47ca4c-d64c-4572-b708-a24300f92cc2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-quobyte-ac47ca4c-d64c-4572-b708-a24300f92cc2" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-ac47ca4c-d64c-4572-b708-a24300f92cc2" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c94b0-7930-4d5b-9506-98ca5d0545b1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:01 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 Aug 28 08:56:01 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:02 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2" returned: 0 in 0.505s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:02 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2 Aug 28 08:56:02 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:02 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ac47ca4c-d64c-4572-b708-a24300f92cc2" returned: 0 in 0.337s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-ac47ca4c-d64c-4572-b708-a24300f92cc2" released by "delete_volume" :: held 0.894s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Created reservations ['f2a96d13-0c60-4ea9-972f-1125cd38cedf', 'f4472fb0-c574-4eb1-9f1b-6770abe26bee', 'b50239eb-e3b0-4c13-8b95-dc8608323ffb', '861e0b99-a643-4d75-ae8f-4cb78a20391c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:02 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:02 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:03 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:03 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Deleted volume successfully. Aug 28 08:56:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a0f22a08-ed1f-4684-9e91-5a68af01f438 tempest-ProjectReaderTests-467865855 None] Lock "cinder-ac47ca4c-d64c-4572-b708-a24300f92cc2-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (8c52dc20-7093-4df2-9948-95dde7d2c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed95556-99b2-4b4e-8c71-98b9280f7cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed95556-99b2-4b4e-8c71-98b9280f7cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130678738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888ea7f3-1d87-4926-86bc-b9d80685160a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:05Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a13ab98-d9ca-4cea-a283-9cfa8ec8090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a13ab98-d9ca-4cea-a283-9cfa8ec8090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497011ba-1422-4525-8933-27a73c901cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497011ba-1422-4525-8933-27a73c901cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888ea7f3-1d87-4926-86bc-b9d80685160a', 'volume_name': 'volume-888ea7f3-1d87-4926-86bc-b9d80685160a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b5dddc-467b-443f-8349-9617ed9a9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b5dddc-467b-443f-8349-9617ed9a9dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1287500-e761-4657-8d5c-895e0f52d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:04 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Volume 888ea7f3-1d87-4926-86bc-b9d80685160a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888ea7f3-1d87-4926-86bc-b9d80685160a', 'volume_size': 1} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130678738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888ea7f3-1d87-4926-86bc-b9d80685160a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:05Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Creating volume 888ea7f3-1d87-4926-86bc-b9d80685160a {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:04 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:56:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:04 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a 1073741824 Aug 28 08:56:04 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-252af28a-d925-4d17-8f8f-0f921d35a1d0 req-e080947f-7693-41bf-97ae-9b039feb8c5a tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:05 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a 1073741824" returned: 0 in 0.890s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:06 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a Aug 28 08:56:06 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:06 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a" returned: 0 in 0.371s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-252af28a-d925-4d17-8f8f-0f921d35a1d0 req-e080947f-7693-41bf-97ae-9b039feb8c5a tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.712s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1287500-e761-4657-8d5c-895e0f52d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888ea7f3-1d87-4926-86bc-b9d80685160a', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b3fae2-1c64-454a-8d47-92f29b290c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-252af28a-d925-4d17-8f8f-0f921d35a1d0 req-e080947f-7693-41bf-97ae-9b039feb8c5a tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Volume volume-888ea7f3-1d87-4926-86bc-b9d80685160a (888ea7f3-1d87-4926-86bc-b9d80685160a): created successfully Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b3fae2-1c64-454a-8d47-92f29b290c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (8c52dc20-7093-4df2-9948-95dde7d2c346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d0a77e16-6e55-44e7-b23d-eab77624a5ba tempest-ProjectReaderTests-467865855 None] Created volume successfully. Aug 28 08:56:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-252af28a-d925-4d17-8f8f-0f921d35a1d0 req-e080947f-7693-41bf-97ae-9b039feb8c5a tempest-TestInstancesWithCinderVolumes-8290971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-c4817a15-1727-4422-8040-e2399f631839', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dd75247-3ec2-465f-a2ba-2ae096b59b1c', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:56:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-252af28a-d925-4d17-8f8f-0f921d35a1d0 req-e080947f-7693-41bf-97ae-9b039feb8c5a tempest-TestInstancesWithCinderVolumes-8290971 None] attachment_update completed successfully. Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-888ea7f3-1d87-4926-86bc-b9d80685160a-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "cinder-888ea7f3-1d87-4926-86bc-b9d80685160a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-quobyte-888ea7f3-1d87-4926-86bc-b9d80685160a" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-888ea7f3-1d87-4926-86bc-b9d80685160a" acquired by "delete_volume" :: waited 0.032s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376f62c-7237-40f3-b6da-db14e4694387]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:07 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a Aug 28 08:56:07 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:08 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a" returned: 0 in 0.784s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:08 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a Aug 28 08:56:08 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:08 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-888ea7f3-1d87-4926-86bc-b9d80685160a" returned: 0 in 0.489s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-888ea7f3-1d87-4926-86bc-b9d80685160a" released by "delete_volume" :: held 1.366s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Created reservations ['ad064daf-caff-4d55-8673-06e4a62faa44', 'a93dd784-91cf-4538-a94f-bc145611d522', '0eb44de9-88f8-4849-b86d-ed4b25f6c5ba', 'b4ec7644-29f2-4980-9a6e-43cad443e27c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:08 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:08 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:09 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.463s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:09 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Deleted volume successfully. Aug 28 08:56:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a17ef62b-cdb7-4aca-ad60-432d734d078d tempest-ProjectReaderTests-467865855 None] Lock "cinder-888ea7f3-1d87-4926-86bc-b9d80685160a-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (0480ee7b-81df-4461-8122-a6d5b19890ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6aa5d-636f-4712-980d-2bb8179ae54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6aa5d-636f-4712-980d-2bb8179ae54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256013674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec13157-6e48-4bf2-a05c-99491b881099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:10Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246a297a-7b10-4d20-bd7b-61245299cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246a297a-7b10-4d20-bd7b-61245299cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703a0a8d-0870-43bc-afe6-d25616dfe8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703a0a8d-0870-43bc-afe6-d25616dfe8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec13157-6e48-4bf2-a05c-99491b881099', 'volume_name': 'volume-1ec13157-6e48-4bf2-a05c-99491b881099', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c97227b-f1d6-49a3-a9e8-dc4eb4f734d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c97227b-f1d6-49a3-a9e8-dc4eb4f734d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb957fc8-cb4f-446b-91a2-f64729c643b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:10 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Volume 1ec13157-6e48-4bf2-a05c-99491b881099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec13157-6e48-4bf2-a05c-99491b881099', 'volume_size': 1} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256013674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec13157-6e48-4bf2-a05c-99491b881099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:10Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Creating volume 1ec13157-6e48-4bf2-a05c-99491b881099 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:10 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:10 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 1073741824 Aug 28 08:56:10 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3002fe79-3c33-46a1-ae47-a3880aeb460b req-0f94de8a-f3e6-44af-987b-903183ca9605 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:11 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 1073741824" returned: 0 in 0.708s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:11 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 Aug 28 08:56:11 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:11 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3002fe79-3c33-46a1-ae47-a3880aeb460b req-0f94de8a-f3e6-44af-987b-903183ca9605 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-3002fe79-3c33-46a1-ae47-a3880aeb460b req-0f94de8a-f3e6-44af-987b-903183ca9605 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb957fc8-cb4f-446b-91a2-f64729c643b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec13157-6e48-4bf2-a05c-99491b881099', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:11 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a22f4c2-cd1a-4139-ac72-152b908d9709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:12 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Volume volume-1ec13157-6e48-4bf2-a05c-99491b881099 (1ec13157-6e48-4bf2-a05c-99491b881099): created successfully Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a22f4c2-cd1a-4139-ac72-152b908d9709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (0480ee7b-81df-4461-8122-a6d5b19890ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c9b393bb-4475-47f4-8bb5-6f095648923f tempest-ProjectReaderTests-467865855 None] Created volume successfully. Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3002fe79-3c33-46a1-ae47-a3880aeb460b req-0f94de8a-f3e6-44af-987b-903183ca9605 tempest-TestInstancesWithCinderVolumes-8290971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd956071a-d623-4ff3-b8da-1b7f8d51de11', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:56:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-3002fe79-3c33-46a1-ae47-a3880aeb460b req-0f94de8a-f3e6-44af-987b-903183ca9605 tempest-TestInstancesWithCinderVolumes-8290971 None] attachment_update completed successfully. Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-1ec13157-6e48-4bf2-a05c-99491b881099-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "cinder-1ec13157-6e48-4bf2-a05c-99491b881099-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-quobyte-1ec13157-6e48-4bf2-a05c-99491b881099" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-1ec13157-6e48-4bf2-a05c-99491b881099" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd42af-6d47-4c90-bf06-0d595fbbb4c6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:13 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 Aug 28 08:56:13 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:13 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099" returned: 0 in 0.587s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:13 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099 Aug 28 08:56:13 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:13 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1ec13157-6e48-4bf2-a05c-99491b881099" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-1ec13157-6e48-4bf2-a05c-99491b881099" released by "delete_volume" :: held 1.017s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Created reservations ['3bc9e46f-bf5c-4b1e-8b22-aed4b1907e4c', 'da437aca-97e1-48f5-a78f-31962d4e7209', '5a90acf2-21a2-4cce-b955-3e7b356f4268', '1679a0d8-03d7-43a5-8a7e-5edfb4473d34'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:14 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:14 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:14 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.412s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Deleted volume successfully. Aug 28 08:56:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cbe98bb-8434-4ab5-b6b8-c1b4b2ebdfff tempest-ProjectReaderTests-467865855 None] Lock "cinder-1ec13157-6e48-4bf2-a05c-99491b881099-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (fd583340-124c-44bb-ae13-edb9e3f14932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e8d1eb-6fc4-4cdd-a48a-b57ab6cf588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e8d1eb-6fc4-4cdd-a48a-b57ab6cf588f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93482328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:16Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61863b41-b758-4844-af94-aabfa455437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61863b41-b758-4844-af94-aabfa455437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53b989a-2e8f-44cd-925b-c2bdbb6f7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53b989a-2e8f-44cd-925b-c2bdbb6f7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41', 'volume_name': 'volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f99e505-ac72-490f-8825-df96dfe0c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f99e505-ac72-490f-8825-df96dfe0c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d03759-7b49-45a6-9e31-f4024f657072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Volume dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41', 'volume_size': 1} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93482328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16dbb01564d44f5380a9443290ea98ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:16Z,use_quota=True,user_id='e2deea955d594c00b54d6e04b8de0622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Creating volume dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:16 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:56:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:16 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 1073741824 Aug 28 08:56:16 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:17 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 1073741824" returned: 0 in 0.874s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:17 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 Aug 28 08:56:17 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Flow 'volume_create_manager' (bcd160a0-0944-4469-8ea6-d19e5feb14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d7b95b-b27e-4974-93d7-5196fa0dd119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d7b95b-b27e-4974-93d7-5196fa0dd119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1734047470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df8a877-39ef-44c5-b800-8dedb3c8682d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bf5c3f6e244e32ba964713fc8a5c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:18Z,use_quota=True,user_id='6f5e0c2a840d48d5875a7cf5c8904051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b06ce7-81d1-4689-8d0f-f0cd3386dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b06ce7-81d1-4689-8d0f-f0cd3386dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ede1a2-65fb-4776-a1b7-c6fb121cb923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ede1a2-65fb-4776-a1b7-c6fb121cb923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df8a877-39ef-44c5-b800-8dedb3c8682d', 'volume_name': 'volume-4df8a877-39ef-44c5-b800-8dedb3c8682d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bf5c7a-1232-4662-88a7-ad2ca8a9735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bf5c7a-1232-4662-88a7-ad2ca8a9735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b417a-bf8f-4d6e-b42d-0fc18944718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Volume 4df8a877-39ef-44c5-b800-8dedb3c8682d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df8a877-39ef-44c5-b800-8dedb3c8682d', 'volume_size': 1} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:17 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" returned: 0 in 0.432s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1734047470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df8a877-39ef-44c5-b800-8dedb3c8682d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bf5c3f6e244e32ba964713fc8a5c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:18Z,use_quota=True,user_id='6f5e0c2a840d48d5875a7cf5c8904051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Creating volume 4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:17 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d03759-7b49-45a6-9e31-f4024f657072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d 1073741824 Aug 28 08:56:17 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78420e8f-22a9-4fcf-bfa8-6997eda69d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Volume volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 (dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41): created successfully Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78420e8f-22a9-4fcf-bfa8-6997eda69d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Flow 'volume_create_manager' (fd583340-124c-44bb-ae13-edb9e3f14932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-012089c3-dce6-45d9-9e82-4b43c8e35489 tempest-ProjectReaderTests-467865855 None] Created volume successfully. Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "cinder-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Acquiring lock "cinder-quobyte-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3866f4-1e6b-406a-87f5-a2743ff0ca85]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:18 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d 1073741824" returned: 0 in 0.877s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:18 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:18 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:19 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 Aug 28 08:56:19 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:19 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.479s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b417a-bf8f-4d6e-b42d-0fc18944718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df8a877-39ef-44c5-b800-8dedb3c8682d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc202b9-5ee9-484c-8919-5ea27d3c9758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Volume volume-4df8a877-39ef-44c5-b800-8dedb3c8682d (4df8a877-39ef-44c5-b800-8dedb3c8682d): created successfully Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc202b9-5ee9-484c-8919-5ea27d3c9758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Flow 'volume_create_manager' (bcd160a0-0944-4469-8ea6-d19e5feb14bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-40db511a-fa3d-40e5-885e-6bb0bb19f05e tempest-SnapshotDependencyTests-121210280 None] Created volume successfully. Aug 28 08:56:19 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" returned: 0 in 0.834s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:19 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41 Aug 28 08:56:19 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:19 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" returned: 0 in 0.438s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "cinder-quobyte-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41" released by "delete_volume" :: held 1.376s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Created reservations ['6cb2ffdb-7528-4d4a-ac5a-b36614377732', '84e4ed09-b98e-4df5-bcd5-41a207f19bc0', 'cc3a13a8-0699-4d87-a287-a0afbadc8b4b', '4d504521-308c-4ac5-b227-c4f0180f28f4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:20 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:20 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Creating offline snapshot 4e066810-a456-46f5-b17d-b534f7606d9a of volume 4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74952e-d27e-4c7b-aa35-ff230f8efa20]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:20 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:20 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:20 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.526s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:20 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Deleted volume successfully. Aug 28 08:56:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0718013f-12cf-4586-8392-778b75f90816 tempest-ProjectReaderTests-467865855 None] Lock "cinder-dbbaf3ea-fa80-4264-aa6f-acdbb3c51e41-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-b19c4fa5-8eb2-4ca6-b4c2-c49e71c9c373 req-092ebd9e-eaae-43e4-9d75-901827658e60 tempest-TestInstancesWithCinderVolumes-8290971 None] Terminate volume connection completed successfully. Aug 28 08:56:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-b19c4fa5-8eb2-4ca6-b4c2-c49e71c9c373 req-092ebd9e-eaae-43e4-9d75-901827658e60 tempest-TestInstancesWithCinderVolumes-8290971 None] Deleting attachment 4dd75247-3ec2-465f-a2ba-2ae096b59b1c. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:56:21 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.956s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:21 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a 1G Aug 28 08:56:21 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-c4817a15-1727-4422-8040-e2399f631839-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-c4817a15-1727-4422-8040-e2399f631839-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-quobyte-c4817a15-1727-4422-8040-e2399f631839" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-c4817a15-1727-4422-8040-e2399f631839" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117d6f8-bee2-4688-ad62-2822276c5924]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:22 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a 1G" returned: 0 in 1.007s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df8a877-39ef-44c5-b800-8dedb3c8682d -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:22 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df8a877-39ef-44c5-b800-8dedb3c8682d -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:22 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:22 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 Aug 28 08:56:22 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:23 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df8a877-39ef-44c5-b800-8dedb3c8682d -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.837s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:23 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a is being set with open permissions: ugo+rw Aug 28 08:56:23 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839" returned: 0 in 1.034s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:23 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:23 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:23 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839 Aug 28 08:56:23 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:24 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.717s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:24 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info Aug 28 08:56:24 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:24 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c4817a15-1727-4422-8040-e2399f631839" returned: 0 in 0.921s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-c4817a15-1727-4422-8040-e2399f631839" released by "delete_volume" :: held 2.080s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:24 devstack cinder-volume[85762]: WARNING cinder.quota [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797980856-1544599573 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797980856-1544599573, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:24 devstack cinder-volume[85762]: WARNING cinder.quota [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797980856-1544599573 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-797980856-1544599573, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Created reservations ['2aa33c85-360e-4fe4-ac62-0c3d6831e9b1', '8216741a-27a1-4922-9cdf-6449397a0879', '31f3933a-ad65-4b0e-951f-314ab6ed2a7c', '6f599866-5b06-4962-a3cb-71f6985e657b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:24 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info" returned: 0 in 0.642s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info is being set with open permissions: ugo+rw Aug 28 08:56:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:24 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:24 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:24 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info Aug 28 08:56:24 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:25 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.639s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:25 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Deleted volume successfully. Aug 28 08:56:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c26bd527-03a8-4073-a11c-59fc036550da tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-c4817a15-1727-4422-8040-e2399f631839-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:25 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.info" returned: 0 in 0.772s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.154s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-93628a2a-94ac-44f4-b733-2894227a8ad7 tempest-SnapshotDependencyTests-121210280 None] Create snapshot completed successfully Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Flow 'volume_create_manager' (f453f6d7-8244-40f7-b3fb-9c6f8ad2adbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc72f80c-762a-4c3c-b269-f754a818e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc72f80c-762a-4c3c-b269-f754a818e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b1267e-1b03-4ab9-8660-e45db28cff8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bf5c3f6e244e32ba964713fc8a5c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e066810-a456-46f5-b17d-b534f7606d9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:28Z,use_quota=True,user_id='6f5e0c2a840d48d5875a7cf5c8904051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce308acb-7a6a-4aa9-9eb8-fed4167437d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce308acb-7a6a-4aa9-9eb8-fed4167437d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555b3f14-4117-494e-99e5-7938d52f3625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555b3f14-4117-494e-99e5-7938d52f3625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33b1267e-1b03-4ab9-8660-e45db28cff8d', 'volume_name': 'volume-33b1267e-1b03-4ab9-8660-e45db28cff8d', 'volume_size': 1, 'snapshot_id': '4e066810-a456-46f5-b17d-b534f7606d9a'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565305f3-fd1b-4a01-b5ef-00a3508f118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565305f3-fd1b-4a01-b5ef-00a3508f118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7709b9d4-6049-4d5a-9739-0d72da095cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Volume 33b1267e-1b03-4ab9-8660-e45db28cff8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33b1267e-1b03-4ab9-8660-e45db28cff8d', 'volume_size': 1, 'snapshot_id': '4e066810-a456-46f5-b17d-b534f7606d9a'} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a-33b1267e-1b03-4ab9-8660-e45db28cff8d" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a-33b1267e-1b03-4ab9-8660-e45db28cff8d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Creating volume 33b1267e-1b03-4ab9-8660-e45db28cff8d from snapshot 4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] snapshot: 4e066810-a456-46f5-b17d-b534f7606d9a, volume: 33b1267e-1b03-4ab9-8660-e45db28cff8d, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[83081eb1-7570-4079-8d57-639506829e53]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:28 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:28 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-51c9d5a6-aa8d-4bde-9252-3a3f2193694c req-593e9c20-8fdd-4f0f-a406-345bde9756df tempest-TestInstancesWithCinderVolumes-8290971 None] Terminate volume connection completed successfully. Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-51c9d5a6-aa8d-4bde-9252-3a3f2193694c req-593e9c20-8fdd-4f0f-a406-345bde9756df tempest-TestInstancesWithCinderVolumes-8290971 None] Deleting attachment d956071a-d623-4ff3-b8da-1b7f8d51de11. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:56:28 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.426s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4df8a877-39ef-44c5-b800-8dedb3c8682d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[54727f21-d280-48ff-b7e9-ca53ac547c7a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:28 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:28 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:28 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.407s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 08:56:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:28 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d Aug 28 08:56:28 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-e8d8d2ef-3793-4ad3-99ba-a01013b216fb-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-e8d8d2ef-3793-4ad3-99ba-a01013b216fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-quobyte-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[85018bb4-5858-474d-bea0-28d16076badd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:29 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb Aug 28 08:56:29 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:30 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" returned: 0 in 0.944s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:30 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb Aug 28 08:56:30 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:30 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" returned: 0 in 0.478s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-e8d8d2ef-3793-4ad3-99ba-a01013b216fb" released by "delete_volume" :: held 1.527s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:31 devstack cinder-volume[85762]: WARNING cinder.quota [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548343474-1015642837 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548343474-1015642837, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:31 devstack cinder-volume[85762]: WARNING cinder.quota [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548343474-1015642837 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548343474-1015642837, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Created reservations ['19030721-2b32-43d8-830f-891967cc11a4', 'd308efef-c489-4f0d-8bda-fedf6186f6c6', 'ffb3af9c-15a1-40fc-a566-123b283809bf', '37bf1e2f-5c43-4318-97ab-019db6dbddce'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:31 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:31 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:32 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.989s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:32 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Deleted volume successfully. Aug 28 08:56:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bbaf7012-223e-4468-9eb3-f43d7ff8af9d tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-e8d8d2ef-3793-4ad3-99ba-a01013b216fb-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:35 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d" returned: 0 in 6.978s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:35 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 08:56:35 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Converted 1024.00 MB image at 146.72 MB/s Aug 28 08:56:35 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d is being set with open permissions: ugo+rw Aug 28 08:56:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:35 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d Aug 28 08:56:35 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:36 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d" returned: 0 in 0.414s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" released by "_copy_volume_from_snapshot" :: held 8.347s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=79,cinder:UPDATE=80,cinder:INSERT=22,cinder:DELETE=7 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=83,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=7 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a-33b1267e-1b03-4ab9-8660-e45db28cff8d" released by "_create_volume_from_snapshot" :: held 8.481s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.505s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7709b9d4-6049-4d5a-9739-0d72da095cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b1267e-1b03-4ab9-8660-e45db28cff8d', 'volume_size': 1, 'snapshot_id': '4e066810-a456-46f5-b17d-b534f7606d9a'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f05b0a3-ecdb-4ac0-9b99-ac1438dc58f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Volume volume-33b1267e-1b03-4ab9-8660-e45db28cff8d (33b1267e-1b03-4ab9-8660-e45db28cff8d): created successfully Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f05b0a3-ecdb-4ac0-9b99-ac1438dc58f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Flow 'volume_create_manager' (f453f6d7-8244-40f7-b3fb-9c6f8ad2adbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8a26c40d-eed3-4705-b02e-ab2009f18418 tempest-SnapshotDependencyTests-121210280 None] Created volume successfully. Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-4e066810-a456-46f5-b17d-b534f7606d9a-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-4e066810-a456-46f5-b17d-b534f7606d9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Deleting offline snapshot 4e066810-a456-46f5-b17d-b534f7606d9a of volume 4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] snapshot_file for this snap is: volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81f0de-eb97-42a1-b14b-a2f0d1be7d79]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:37 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:37 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:38 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.499s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4df8a877-39ef-44c5-b800-8dedb3c8682d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37075f-d901-48b7-9323-0181b759b15b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:38 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:38 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-3b891983-cfb3-44ab-9e9d-5c6621d4d17a req-4094543f-1e41-4315-bc83-f774ebd1f0d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Terminate volume connection completed successfully. Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-3b891983-cfb3-44ab-9e9d-5c6621d4d17a req-4094543f-1e41-4315-bc83-f774ebd1f0d5 tempest-TestInstancesWithCinderVolumes-8290971 None] Deleting attachment 51a28fda-f055-4ecc-9ffa-889c505e1590. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:56:38 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.790s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:39 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:39 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:39 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.571s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:39 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a Aug 28 08:56:39 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:40 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d.4e066810-a456-46f5-b17d-b534f7606d9a" returned: 0 in 0.440s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4e066810-a456-46f5-b17d-b534f7606d9a" released by "_delete_snapshot" :: held 2.442s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" released by "delete_snapshot" :: held 2.478s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Created reservations ['1dcccaef-cb24-4097-9eaf-25ec8c0f7408', '6db5863c-1204-4bfb-af35-56c0c1cb2498', 'da4ebf10-8242-4b4f-a96b-4b96889623c4', '08596272-c6a7-4a4a-acd7-7f171477d7c7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Delete snapshot completed successfully. Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e37b98ab-efb9-4062-aee1-e9c9764395cf tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-4e066810-a456-46f5-b17d-b534f7606d9a-delete_snapshot" released by "delete_snapshot" :: held 2.689s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:40 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:40 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:40 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-4df8a877-39ef-44c5-b800-8dedb3c8682d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-4df8a877-39ef-44c5-b800-8dedb3c8682d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46b005-24e9-44c3-99da-cf8b30f34ee6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-87d262bc-57df-4324-9e39-a7a11fb33b17-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-87d262bc-57df-4324-9e39-a7a11fb33b17-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "cinder-quobyte-87d262bc-57df-4324-9e39-a7a11fb33b17" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-87d262bc-57df-4324-9e39-a7a11fb33b17" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3074014-6de2-4398-9d65-0032475d295c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:41 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:41 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:41 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 Aug 28 08:56:41 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:41 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.512s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:41 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d Aug 28 08:56:41 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:41 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17" returned: 0 in 0.536s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:41 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17 Aug 28 08:56:41 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:41 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4df8a877-39ef-44c5-b800-8dedb3c8682d" returned: 0 in 0.317s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-4df8a877-39ef-44c5-b800-8dedb3c8682d" released by "delete_volume" :: held 0.908s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Created reservations ['f9e33d62-2531-4987-8059-6c2aa72ba443', 'c99008fd-7b38-42b3-a6db-5513b7bc464d', 'b81b75aa-e9de-4f32-bcc5-5f4679a69885', '054f127d-93cf-4c7e-9180-e011abb430cf'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:42 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:42 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:42 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-87d262bc-57df-4324-9e39-a7a11fb33b17" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-33b1267e-1b03-4ab9-8660-e45db28cff8d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-quobyte-87d262bc-57df-4324-9e39-a7a11fb33b17" released by "delete_volume" :: held 0.961s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-33b1267e-1b03-4ab9-8660-e45db28cff8d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:42 devstack cinder-volume[85762]: WARNING cinder.quota [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553612543-659403810 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553612543-659403810, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:42 devstack cinder-volume[85762]: WARNING cinder.quota [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553612543-659403810 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553612543-659403810, it is now deprecated. Please use the default quota class for default quota. Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Created reservations ['cbdeb222-21d6-4b89-a365-5de0def68207', 'e5c121a1-7398-4b6a-a9b0-5adefe871229', 'f5b43d89-1b26-4a96-b861-bffc63778224', '4b50c436-92fe-46d8-b65f-a1e0afa95304'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" acquired by "delete_volume" :: waited 0.048s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef6fb6-e7b2-43a3-b66c-54842c4e49a6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:42 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.467s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Deleted volume successfully. Aug 28 08:56:42 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:42 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-27b68b20-3422-44a0-9f07-d066ebeadb57 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-4df8a877-39ef-44c5-b800-8dedb3c8682d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:42 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d Aug 28 08:56:42 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:42 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Deleted volume successfully. Aug 28 08:56:42 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d" returned: 0 in 0.507s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f2582fba-d636-4178-9909-bb1d108565f9 tempest-TestInstancesWithCinderVolumes-8290971 None] Lock "cinder-87d262bc-57df-4324-9e39-a7a11fb33b17-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:42 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d Aug 28 08:56:42 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:43 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-33b1267e-1b03-4ab9-8660-e45db28cff8d" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-quobyte-33b1267e-1b03-4ab9-8660-e45db28cff8d" released by "delete_volume" :: held 0.864s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Created reservations ['9a57f558-ccfb-40d1-a770-1115334dbad6', '2d5723b4-c7da-4847-95e9-6b799dbc4594', '452fa6da-a2d3-4905-bec5-e891efab2998', '194a76a5-49b4-4666-867f-3c1fab1e73dd'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:43 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:56:43 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:43 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:56:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Deleted volume successfully. Aug 28 08:56:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-36be8468-7f9f-4e8c-9925-83f66d5509f7 tempest-SnapshotDependencyTests-121210280 None] Lock "cinder-33b1267e-1b03-4ab9-8660-e45db28cff8d-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (776b6be9-e13a-4a7d-9a7e-0579819effea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912572de-e285-4066-981d-c708c9cc5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912572de-e285-4066-981d-c708c9cc5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509424474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:45Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d862c340-9438-4d2a-ab23-1a24413455ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d862c340-9438-4d2a-ab23-1a24413455ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecb69f4-75c7-44ea-9370-9bd1dd6be537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecb69f4-75c7-44ea-9370-9bd1dd6be537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca', 'volume_name': 'volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726536e8-9eda-4a84-9619-ed4856084d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726536e8-9eda-4a84-9619-ed4856084d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1752894d-20e9-42a1-9fb8-2a4caa3e975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Volume 2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca', 'volume_size': 1} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-509424474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:56:45Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Creating volume 2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:56:44 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:56:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:44 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca 1073741824 Aug 28 08:56:44 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:45 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca 1073741824" returned: 0 in 0.647s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:56:45 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca Aug 28 08:56:45 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:56:45 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" returned: 0 in 0.356s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1752894d-20e9-42a1-9fb8-2a4caa3e975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18a409d-b5d4-444b-be66-40d6419e5a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:56:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Volume volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca (2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca): created successfully Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18a409d-b5d4-444b-be66-40d6419e5a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:56:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (776b6be9-e13a-4a7d-9a7e-0579819effea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:56:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-27547f83-984f-4e67-8423-5ea8678549fc tempest-AttachVolumeNegativeTest-1941395167 None] Created volume successfully. Aug 28 08:56:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-78554875-25fc-4dcf-af45-4a26c1d4f014 req-5d0013c5-074b-44fe-944d-b88cddd4bea8 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:56:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-78554875-25fc-4dcf-af45-4a26c1d4f014 req-5d0013c5-074b-44fe-944d-b88cddd4bea8 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:56:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-78554875-25fc-4dcf-af45-4a26c1d4f014 req-5d0013c5-074b-44fe-944d-b88cddd4bea8 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:56:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-78554875-25fc-4dcf-af45-4a26c1d4f014 req-5d0013c5-074b-44fe-944d-b88cddd4bea8 tempest-AttachVolumeNegativeTest-1941395167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea3e169b-3e68-4d5a-be56-38317ca59a64', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:56:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-78554875-25fc-4dcf-af45-4a26c1d4f014 req-5d0013c5-074b-44fe-944d-b88cddd4bea8 tempest-AttachVolumeNegativeTest-1941395167 None] attachment_update completed successfully. Aug 28 08:56:57 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=34,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:56:57 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=35,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:57:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f4a9204b-8b56-402f-9e4a-31d75204b4c4 req-af3e96ab-05f1-4a5f-a3c1-e830070cdade tempest-AttachVolumeNegativeTest-1941395167 None] Terminate volume connection completed successfully. Aug 28 08:57:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f4a9204b-8b56-402f-9e4a-31d75204b4c4 req-af3e96ab-05f1-4a5f-a3c1-e830070cdade tempest-AttachVolumeNegativeTest-1941395167 None] Deleting attachment ea3e169b-3e68-4d5a-be56-38317ca59a64. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:57:40 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:57:40 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:57:40 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:57:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:57:44 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Flow 'volume_create_manager' (03e14c1e-dc49-4175-8b64-1317d67ca1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eccc7a0-d6bd-4da8-943f-72f75c558469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eccc7a0-d6bd-4da8-943f-72f75c558469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-751513286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df6fb5a-5ddc-479c-ba4f-00499bdb08ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0c3ad7a9d8470d946a9dead3106594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:58:03Z,use_quota=True,user_id='3aacdbac376d4b9881c3d075c5af27c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f30d55-ae14-40fa-8224-069c162738cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f30d55-ae14-40fa-8224-069c162738cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9481360-c6bf-4099-835e-93e437956a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9481360-c6bf-4099-835e-93e437956a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df6fb5a-5ddc-479c-ba4f-00499bdb08ad', 'volume_name': 'volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a1943-e06f-4010-a3b4-1ff5e58666e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a1943-e06f-4010-a3b4-1ff5e58666e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0644c0c-e635-4e17-a006-df04123a6cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Volume 8df6fb5a-5ddc-479c-ba4f-00499bdb08ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad', 'volume_size': 1} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-751513286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df6fb5a-5ddc-479c-ba4f-00499bdb08ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0c3ad7a9d8470d946a9dead3106594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:58:03Z,use_quota=True,user_id='3aacdbac376d4b9881c3d075c5af27c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Creating volume 8df6fb5a-5ddc-479c-ba4f-00499bdb08ad {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:58:02 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:58:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:02 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad 1073741824 Aug 28 08:58:02 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:03 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad 1073741824" returned: 0 in 0.456s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:03 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad Aug 28 08:58:03 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:03 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" returned: 0 in 0.267s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0644c0c-e635-4e17-a006-df04123a6cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5bbf32-2fec-4c10-97f5-aaa3996a0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:03 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Volume volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad (8df6fb5a-5ddc-479c-ba4f-00499bdb08ad): created successfully Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5bbf32-2fec-4c10-97f5-aaa3996a0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Flow 'volume_create_manager' (03e14c1e-dc49-4175-8b64-1317d67ca1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:58:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-478525a2-d386-4db2-95df-bed7db7f3fa1 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Created volume successfully. Aug 28 08:58:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-77450b94-3781-4398-be02-db454dd64572 req-9a90410b-e391-44be-9bee-31756a9002a9 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-77450b94-3781-4398-be02-db454dd64572 req-9a90410b-e391-44be-9bee-31756a9002a9 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-77450b94-3781-4398-be02-db454dd64572 req-9a90410b-e391-44be-9bee-31756a9002a9 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-77450b94-3781-4398-be02-db454dd64572 req-9a90410b-e391-44be-9bee-31756a9002a9 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd491150d-d70b-4c76-aed5-49647adc6917', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:58:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-77450b94-3781-4398-be02-db454dd64572 req-9a90410b-e391-44be-9bee-31756a9002a9 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] attachment_update completed successfully. Aug 28 08:58:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-da1e90c9-4723-4aaa-9143-6f04ccd70e9a req-1d67cbe7-408e-4700-b5a0-ee761e60f5f7 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Terminate volume connection completed successfully. Aug 28 08:58:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-da1e90c9-4723-4aaa-9143-6f04ccd70e9a req-1d67cbe7-408e-4700-b5a0-ee761e60f5f7 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Deleting attachment d491150d-d70b-4c76-aed5-49647adc6917. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:58:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "cinder-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:58:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "cinder-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:58:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "cinder-quobyte-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "cinder-quobyte-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdb28f6-426e-49f4-acfb-add4e9ec5e25]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:10 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad Aug 28 08:58:10 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:10 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" returned: 0 in 0.395s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:10 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad Aug 28 08:58:10 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:10 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" returned: 0 in 0.281s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "cinder-quobyte-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad" released by "delete_volume" :: held 0.724s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Created reservations ['89f4acb5-bd01-4abe-831f-898648a5d559', '07a3642e-efe2-4b4d-98ad-60eba3d671db', 'c9c6a684-3519-4141-9902-00d790f0d187', '31f73a4e-102f-4ec8-90cc-86581d9567bb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:10 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:58:10 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:11 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:11 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:58:11 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Deleted volume successfully. Aug 28 08:58:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c99f27d4-de53-436c-9938-a0309fe76408 tempest-TestServerVolumeAttachScenarioOldVersion-1784093037 None] Lock "cinder-8df6fb5a-5ddc-479c-ba4f-00499bdb08ad-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (a3c74f14-d8d5-4096-ad43-212c65c3ab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e983e0a1-d97f-43b3-bde9-66e41c912ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e983e0a1-d97f-43b3-bde9-66e41c912ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1395076518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eb86c9-bb4b-4a11-a193-6dc49f0bcef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:58:16Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ae5bdb-0b50-4ce4-b27d-958068d47634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ae5bdb-0b50-4ce4-b27d-958068d47634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcc6f7d-bad2-477c-9ed9-bcdb6bbe4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcc6f7d-bad2-477c-9ed9-bcdb6bbe4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50eb86c9-bb4b-4a11-a193-6dc49f0bcef7', 'volume_name': 'volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5c8d78-231a-4f5b-a64e-26c2a5587a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5c8d78-231a-4f5b-a64e-26c2a5587a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19322e5a-63a3-486b-aca2-83afe7e113f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Volume 50eb86c9-bb4b-4a11-a193-6dc49f0bcef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7', 'volume_size': 1} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1395076518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eb86c9-bb4b-4a11-a193-6dc49f0bcef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:58:16Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Creating volume 50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:58:16 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:16 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 1073741824 Aug 28 08:58:16 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:16 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 1073741824" returned: 0 in 0.515s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:16 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 Aug 28 08:58:16 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:16 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:58:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19322e5a-63a3-486b-aca2-83afe7e113f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d6b4b-ed59-43c0-9202-43616f7e2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:58:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Volume volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 (50eb86c9-bb4b-4a11-a193-6dc49f0bcef7): created successfully Aug 28 08:58:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d6b4b-ed59-43c0-9202-43616f7e2192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:58:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (a3c74f14-d8d5-4096-ad43-212c65c3ab81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:58:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-817ef9c2-70e3-48e7-bcff-352270ef5970 tempest-AttachVolumeNegativeTest-1941395167 None] Created volume successfully. Aug 28 08:58:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-6f21768f-6317-43db-bbf7-bf646409f63c req-967e65db-217f-428b-94bd-aa60308ce179 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-6f21768f-6317-43db-bbf7-bf646409f63c req-967e65db-217f-428b-94bd-aa60308ce179 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-6f21768f-6317-43db-bbf7-bf646409f63c req-967e65db-217f-428b-94bd-aa60308ce179 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-6f21768f-6317-43db-bbf7-bf646409f63c req-967e65db-217f-428b-94bd-aa60308ce179 tempest-AttachVolumeNegativeTest-1941395167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b74d7df9-ddff-4f5e-83cc-5bf0f8defd19', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:58:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-6f21768f-6317-43db-bbf7-bf646409f63c req-967e65db-217f-428b-94bd-aa60308ce179 tempest-AttachVolumeNegativeTest-1941395167 None] attachment_update completed successfully. Aug 28 08:58:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-38767a8c-24ef-4d64-a3e7-cfaba4c9995f req-0c6d69eb-f165-4e15-97e3-ba0a1f7d98fa tempest-AttachVolumeNegativeTest-1941395167 None] Terminate volume connection completed successfully. Aug 28 08:58:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-38767a8c-24ef-4d64-a3e7-cfaba4c9995f req-0c6d69eb-f165-4e15-97e3-ba0a1f7d98fa tempest-AttachVolumeNegativeTest-1941395167 None] Deleting attachment b74d7df9-ddff-4f5e-83cc-5bf0f8defd19. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:58:31 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:58:31 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=23,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:58:40 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:58:40 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:58:40 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.287s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:58:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (b271683b-647a-40d5-b8bb-6a54fe8e9a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e5b491-79a6-435a-9679-42b7491a2b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e5b491-79a6-435a-9679-42b7491a2b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1287725966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43399f-c60c-4690-9b35-6f7416f265fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:01Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c19377-ea5c-403b-a7ec-0773ebb13f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c19377-ea5c-403b-a7ec-0773ebb13f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0982a6-db50-4922-a83b-9ab1b6a39bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0982a6-db50-4922-a83b-9ab1b6a39bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d43399f-c60c-4690-9b35-6f7416f265fb', 'volume_name': 'volume-4d43399f-c60c-4690-9b35-6f7416f265fb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5536e8d7-c5cf-4b0e-a2e1-8ce9358b87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5536e8d7-c5cf-4b0e-a2e1-8ce9358b87a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d29a97-6018-4d89-8bdc-3e1f1128c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Volume 4d43399f-c60c-4690-9b35-6f7416f265fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d43399f-c60c-4690-9b35-6f7416f265fb', 'volume_size': 1} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1287725966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43399f-c60c-4690-9b35-6f7416f265fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059b4af8c2c8497ca201930a87b7b70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:01Z,use_quota=True,user_id='987e257738ac41a080bd0bf633bb8d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Creating volume 4d43399f-c60c-4690-9b35-6f7416f265fb {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:59:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:59:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:00 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb 1073741824 Aug 28 08:59:00 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:01 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb 1073741824" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:01 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb Aug 28 08:59:01 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:01 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d29a97-6018-4d89-8bdc-3e1f1128c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d43399f-c60c-4690-9b35-6f7416f265fb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0e393d-4b9b-49a6-b7d6-594795ef3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Volume volume-4d43399f-c60c-4690-9b35-6f7416f265fb (4d43399f-c60c-4690-9b35-6f7416f265fb): created successfully Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0e393d-4b9b-49a6-b7d6-594795ef3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Flow 'volume_create_manager' (b271683b-647a-40d5-b8bb-6a54fe8e9a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-033f6146-2c1e-4ee1-a408-935bf631aa06 tempest-AttachVolumeNegativeTest-1941395167 None] Created volume successfully. Aug 28 08:59:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-737455df-53de-4eda-86aa-27045af7410e req-45af1f97-b95c-495d-be53-c695cf795482 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-737455df-53de-4eda-86aa-27045af7410e req-45af1f97-b95c-495d-be53-c695cf795482 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-737455df-53de-4eda-86aa-27045af7410e req-45af1f97-b95c-495d-be53-c695cf795482 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-737455df-53de-4eda-86aa-27045af7410e req-45af1f97-b95c-495d-be53-c695cf795482 tempest-AttachVolumeNegativeTest-1941395167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-4d43399f-c60c-4690-9b35-6f7416f265fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e07db3f-bfe5-4df8-8ea0-3126cab9561f', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 08:59:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-737455df-53de-4eda-86aa-27045af7410e req-45af1f97-b95c-495d-be53-c695cf795482 tempest-AttachVolumeNegativeTest-1941395167 None] attachment_update completed successfully. Aug 28 08:59:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-5b2138a6-6964-4c63-b585-c630d27f1058 req-75776b02-92b7-4d35-aed1-69cda00aa3ed tempest-AttachVolumeNegativeTest-1941395167 None] Terminate volume connection completed successfully. Aug 28 08:59:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-5b2138a6-6964-4c63-b585-c630d27f1058 req-75776b02-92b7-4d35-aed1-69cda00aa3ed tempest-AttachVolumeNegativeTest-1941395167 None] Deleting attachment 2e07db3f-bfe5-4df8-8ea0-3126cab9561f. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-4d43399f-c60c-4690-9b35-6f7416f265fb-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-4d43399f-c60c-4690-9b35-6f7416f265fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-quobyte-4d43399f-c60c-4690-9b35-6f7416f265fb" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-4d43399f-c60c-4690-9b35-6f7416f265fb" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc51882-e706-4431-bcd0-add73ba53191]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:11 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb Aug 28 08:59:11 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:11 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:11 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb Aug 28 08:59:11 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:11 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4d43399f-c60c-4690-9b35-6f7416f265fb" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-4d43399f-c60c-4690-9b35-6f7416f265fb" released by "delete_volume" :: held 0.694s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Created reservations ['09ae350a-eb14-499b-a727-26f695ca5534', 'e20d3625-fd0d-4fc5-9ed9-2745c3c8d50e', '092777cf-460d-4513-980b-c3583030643f', '3fd1dbd8-969d-4e0f-8dca-21359f7dfe54'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:11 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:11 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:12 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Deleted volume successfully. Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b83ba4d9-0c2c-4e15-b4e8-21cd8d6d8b42 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-4d43399f-c60c-4690-9b35-6f7416f265fb-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-quobyte-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8185be5-d993-4b3e-8af4-0d4cabdb6b71]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:12 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 Aug 28 08:59:12 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:12 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" returned: 0 in 0.409s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:12 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7 Aug 28 08:59:12 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:13 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" returned: 0 in 0.278s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7" released by "delete_volume" :: held 0.724s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Created reservations ['84a517af-dc62-4eba-93e8-9f0c42ff3c4b', '63c71574-6b28-46c5-890a-187d0ff9ed86', '9ff8997e-386f-4161-8757-cbf4b6907601', '5118f2db-10d7-41b1-9e5e-495d3768c07c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:13 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:13 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:13 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.280s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Deleted volume successfully. Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e80c93ba-f9e6-4534-9968-99cedc9638cb tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-50eb86c9-bb4b-4a11-a193-6dc49f0bcef7-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "cinder-quobyte-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad6c96-7020-4593-904e-93e76cf0e9ec]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:13 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca Aug 28 08:59:13 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:14 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" returned: 0 in 0.376s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:14 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca Aug 28 08:59:14 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:14 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-quobyte-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca" released by "delete_volume" :: held 0.678s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Created reservations ['c09a46e7-9ff0-40cd-88a9-51aca386bb05', '4a39caf4-94da-485c-9359-d7c529919264', '4c02df76-05c6-4ff4-8aa7-31fa2d53a978', '03860a40-0cb8-4090-873b-0c4170b23b58'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:14 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:14 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:14 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Deleted volume successfully. Aug 28 08:59:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0db99feb-60a6-420c-9a25-8e328989e5a3 tempest-AttachVolumeNegativeTest-1941395167 None] Lock "cinder-2bd5fa45-5b2c-401c-b2cf-72ccf4ced8ca-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Flow 'volume_create_manager' (0cc2f310-d5a0-4de9-aeb7-1f00dc5a9c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d658cb-10d1-4675-8387-a448a1830781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d658cb-10d1-4675-8387-a448a1830781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-242697019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925b6045-311e-4470-ba8a-c67d0010f146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079ad388d1a4e62a92345526c4832f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:23Z,use_quota=True,user_id='4ff54377477b4bb6bcfeb1240a0d07f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5538e5b9-c198-42b6-a60c-fe7db5fb6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5538e5b9-c198-42b6-a60c-fe7db5fb6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ad147b-99de-4fb7-a120-180a6c608795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ad147b-99de-4fb7-a120-180a6c608795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925b6045-311e-4470-ba8a-c67d0010f146', 'volume_name': 'volume-925b6045-311e-4470-ba8a-c67d0010f146', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b18ac-fe9f-4e25-96e2-f9499448c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b18ac-fe9f-4e25-96e2-f9499448c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b14930e-83eb-4fde-99f5-ef3c02b14036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Volume 925b6045-311e-4470-ba8a-c67d0010f146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925b6045-311e-4470-ba8a-c67d0010f146', 'volume_size': 1} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-242697019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925b6045-311e-4470-ba8a-c67d0010f146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079ad388d1a4e62a92345526c4832f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:23Z,use_quota=True,user_id='4ff54377477b4bb6bcfeb1240a0d07f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Creating volume 925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:59:23 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:23 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 1073741824 Aug 28 08:59:23 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:23 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 1073741824" returned: 0 in 0.467s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:23 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 Aug 28 08:59:23 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:24 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b14930e-83eb-4fde-99f5-ef3c02b14036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925b6045-311e-4470-ba8a-c67d0010f146', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bd444d-6d1d-43c8-893b-ec9ef9eb5441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:24 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Volume volume-925b6045-311e-4470-ba8a-c67d0010f146 (925b6045-311e-4470-ba8a-c67d0010f146): created successfully Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bd444d-6d1d-43c8-893b-ec9ef9eb5441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Flow 'volume_create_manager' (0cc2f310-d5a0-4de9-aeb7-1f00dc5a9c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-0ee89049-58d3-4c63-885c-beea8865fae4 req-9527c4ae-ab7f-415e-afeb-cdb5688e3894 tempest-VolumesSnapshotsTestJSON-2063168820 None] Created volume successfully. Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Creating offline snapshot 1bcc09df-ee91-48ad-9b69-e8457baa366a of volume 925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[761c14c8-36f0-45f7-a8c3-2c7d4ae36437]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:24 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 Aug 28 08:59:24 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:25 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146" returned: 0 in 0.447s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:25 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a 1G Aug 28 08:59:25 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:25 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a 1G" returned: 0 in 0.505s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b6045-311e-4470-ba8a-c67d0010f146 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:25 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b6045-311e-4470-ba8a-c67d0010f146 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a Aug 28 08:59:25 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:26 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925b6045-311e-4470-ba8a-c67d0010f146 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:26 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a is being set with open permissions: ugo+rw Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:26 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a Aug 28 08:59:26 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:26 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a" returned: 0 in 0.283s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:26 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info Aug 28 08:59:26 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:26 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:26 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info is being set with open permissions: ugo+rw Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:26 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info Aug 28 08:59:26 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:26 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.info" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-76ebb183-54d0-48ac-b3ec-668e5dc961c0 req-1385920e-ee4c-4671-bf35-24171f96f83b tempest-VolumesSnapshotsTestJSON-2063168820 None] Create snapshot completed successfully Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "cinder-1bcc09df-ee91-48ad-9b69-e8457baa366a-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-1bcc09df-ee91-48ad-9b69-e8457baa366a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "cinder-quobyte-1bcc09df-ee91-48ad-9b69-e8457baa366a" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-1bcc09df-ee91-48ad-9b69-e8457baa366a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Deleting offline snapshot 1bcc09df-ee91-48ad-9b69-e8457baa366a of volume 925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] snapshot_file for this snap is: volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[284322d8-b14c-46f4-9f0b-981ff0691482]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:27 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a Aug 28 08:59:27 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:27 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a" returned: 0 in 0.373s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925b6045-311e-4470-ba8a-c67d0010f146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68fe3da-aabb-435c-b7d4-37689a54526e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:27 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 Aug 28 08:59:27 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:28 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146" returned: 0 in 0.383s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:28 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a Aug 28 08:59:28 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:28 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a" returned: 0 in 0.345s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:28 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a Aug 28 08:59:28 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:28 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146.1bcc09df-ee91-48ad-9b69-e8457baa366a" returned: 0 in 0.252s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-1bcc09df-ee91-48ad-9b69-e8457baa366a" released by "_delete_snapshot" :: held 1.462s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" released by "delete_snapshot" :: held 1.493s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG cinder.quota [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Created reservations ['a72899df-138e-426d-8cd4-7c1855a3cc6e', '654349ed-2966-43d7-9962-a0ac2a27138c', '1afaa428-a7ff-4b85-af39-cb0e4098f129', '8bc4576a-6c81-4068-be4b-b196141dedd3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Delete snapshot completed successfully. Aug 28 08:59:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-b6fc2dbf-4609-4133-9d00-1cbecd64d323 req-a5eeb488-b832-46e8-9ffe-3ad39dc5cfe4 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-1bcc09df-ee91-48ad-9b69-e8457baa366a-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "cinder-925b6045-311e-4470-ba8a-c67d0010f146-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-925b6045-311e-4470-ba8a-c67d0010f146-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0917168-d795-48c6-9ae5-56ec2f2236fa]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:29 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 Aug 28 08:59:29 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:29 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146" returned: 0 in 0.368s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:29 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146 Aug 28 08:59:29 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:30 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-925b6045-311e-4470-ba8a-c67d0010f146" returned: 0 in 0.243s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-quobyte-925b6045-311e-4470-ba8a-c67d0010f146" released by "delete_volume" :: held 0.669s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.quota [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Created reservations ['766332f4-b4c1-4652-bbe9-2cea3dd6c219', '31f8749d-a58c-4786-9b90-50cb042ccfec', '9f82c920-e685-4ac7-bce0-d17e13269d90', 'a67a484d-8bb2-472d-b064-9751020edf44'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:30 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:30 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:30 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.246s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.manager [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Deleted volume successfully. Aug 28 08:59:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-f6b9df63-ac7a-402c-961e-c19372bea091 req-34aa874a-75c2-475a-89af-b1ca9f256642 tempest-VolumesSnapshotsTestJSON-2063168820 None] Lock "cinder-925b6045-311e-4470-ba8a-c67d0010f146-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-09ac4cc7-514b-4d13-9fa4-dbc9b1026c16 tempest-GroupsV320Test-1880663897 None] Group tempest-GroupsV320Test-Group-629957225: creating Aug 28 08:59:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-09ac4cc7-514b-4d13-9fa4-dbc9b1026c16 tempest-GroupsV320Test-1880663897 None] Group tempest-GroupsV320Test-Group-629957225: created successfully Aug 28 08:59:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-09ac4cc7-514b-4d13-9fa4-dbc9b1026c16 tempest-GroupsV320Test-1880663897 None] Create group completed successfully. Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Created reservations ['937845a3-76d6-49d0-8c49-36bf57702510'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:36 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:36 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:36 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:36 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b3f53794-99af-4362-bc52-1b2e82f7d50c tempest-GroupsV320Test-1880663897 None] Delete group completed successfully. Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:40 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 08:59:40 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:40 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 08:59:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 08:59:46 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=42,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=4 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:59:46 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=52,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=3 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Flow 'volume_create_manager' (94d41e64-5ef1-4a70-9ee8-a27f71bd9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbd69f5-811f-46d7-b5b1-4b447ecd56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbd69f5-811f-46d7-b5b1-4b447ecd56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1447002994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0231f4d-a637-4274-852d-700dcb901f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a072c3038a4c22a4cfd474b5039edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:48Z,use_quota=True,user_id='1e313c2654a04cc79cf05744eda750e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba46f74-8d51-4f97-8298-15210b1e501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba46f74-8d51-4f97-8298-15210b1e501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4130d3-a257-4114-9081-001a0f2dacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4130d3-a257-4114-9081-001a0f2dacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0231f4d-a637-4274-852d-700dcb901f70', 'volume_name': 'volume-d0231f4d-a637-4274-852d-700dcb901f70', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02871515-e2cd-4539-8c6f-4a0580277f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02871515-e2cd-4539-8c6f-4a0580277f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d0d5a5-0d95-4d1b-b7e9-0df7b3c4ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:48 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Volume d0231f4d-a637-4274-852d-700dcb901f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0231f4d-a637-4274-852d-700dcb901f70', 'volume_size': 1} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T06:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1447002994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0231f4d-a637-4274-852d-700dcb901f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a072c3038a4c22a4cfd474b5039edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T06:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T06:59:48Z,use_quota=True,user_id='1e313c2654a04cc79cf05744eda750e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Creating volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 08:59:48 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:48 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 1073741824 Aug 28 08:59:48 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:48 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 1073741824" returned: 0 in 0.458s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:48 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 Aug 28 08:59:48 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:49 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70" returned: 0 in 0.261s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d0d5a5-0d95-4d1b-b7e9-0df7b3c4ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0231f4d-a637-4274-852d-700dcb901f70', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2fe5de-72d3-4767-9d18-2f3f0e71a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 08:59:49 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Volume volume-d0231f4d-a637-4274-852d-700dcb901f70 (d0231f4d-a637-4274-852d-700dcb901f70): created successfully Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2fe5de-72d3-4767-9d18-2f3f0e71a075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Flow 'volume_create_manager' (94d41e64-5ef1-4a70-9ee8-a27f71bd9e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 08:59:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c8a554a8-e1dd-43fd-8923-1d40e7d7e1e3 tempest-SnapshotsActionsTest-530145771 None] Created volume successfully. Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Creating offline snapshot 79be036e-45f6-4323-9ac6-e2715934df13 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a32d67-0ea9-4c41-92e6-83408c85929a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:50 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 Aug 28 08:59:50 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:50 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:50 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 1G Aug 28 08:59:50 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:50 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 1G" returned: 0 in 0.431s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:50 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 08:59:50 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:51 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:51 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 is being set with open permissions: ugo+rw Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:51 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 08:59:51 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:51 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.279s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:51 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info Aug 28 08:59:51 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:51 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info" returned: 0 in 0.273s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:51 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info is being set with open permissions: ugo+rw Aug 28 08:59:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:51 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info Aug 28 08:59:51 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:52 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.info" returned: 0 in 0.289s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:52 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-79144a08-b421-4621-8bbd-62044758b5a3 tempest-SnapshotsActionsTest-530145771 None] Create snapshot completed successfully Aug 28 08:59:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Creating offline snapshot b171cc66-e04a-4066-b644-3106691a831f of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:59:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4945d5-603c-40ce-ac73-540d18447148]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:53 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 08:59:53 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:54 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.403s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:54 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f 1G Aug 28 08:59:54 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:54 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f 1G" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:54 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f Aug 28 08:59:54 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:54 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f" returned: 0 in 0.300s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:54 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f is being set with open permissions: ugo+rw Aug 28 08:59:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:54 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f Aug 28 08:59:54 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:55 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f" returned: 0 in 0.248s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.509s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e5239ca9-efea-41bc-a195-777db5b2ebff tempest-SnapshotsActionsTest-530145771 None] Create snapshot completed successfully Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-b171cc66-e04a-4066-b644-3106691a831f-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-b171cc66-e04a-4066-b644-3106691a831f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-b171cc66-e04a-4066-b644-3106691a831f" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-b171cc66-e04a-4066-b644-3106691a831f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Deleting offline snapshot b171cc66-e04a-4066-b644-3106691a831f of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] snapshot_file for this snap is: volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a50241-e016-4c7a-9a2b-64d7bf56dda4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:56 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f Aug 28 08:59:56 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:56 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f" returned: 0 in 0.402s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffe6fd-7318-4b99-a2f8-fc2d41bc5446]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:56 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 08:59:56 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:56 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.388s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:59:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:56 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f Aug 28 08:59:56 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:57 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:57 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f Aug 28 08:59:57 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:57 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.b171cc66-e04a-4066-b644-3106691a831f" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-b171cc66-e04a-4066-b644-3106691a831f" released by "_delete_snapshot" :: held 1.563s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_snapshot" :: held 1.584s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Created reservations ['8a95fe18-c518-4f80-b516-1e4488c16c0c', '5dc1b304-b952-44f5-a52f-0f78c60d0890', 'c1a777a1-6fad-40da-ad6d-21ca84e3d9f7', 'b588b4ba-30ce-4e06-a34e-da201df3c7cb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 08:59:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Delete snapshot completed successfully. Aug 28 08:59:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-748fe64e-c38a-416f-8d27-ba0578b442a0 tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-b171cc66-e04a-4066-b644-3106691a831f-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Creating offline snapshot 641b3de9-5d7a-4bef-a64d-fdbc723b4961 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4b8e4-c050-4cb8-801e-28a7269cd47c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:58 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 08:59:58 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:58 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 08:59:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:58 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 1G Aug 28 08:59:58 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:59 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 1G" returned: 0 in 0.485s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:59 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 Aug 28 08:59:59 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:59 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961" returned: 0 in 0.361s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:59 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 is being set with open permissions: ugo+rw Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 08:59:59 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 Aug 28 08:59:59 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 08:59:59 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961" returned: 0 in 0.271s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 08:59:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.638s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 08:59:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b88668c5-dde8-4474-8820-9526115ee5d9 tempest-SnapshotsActionsTest-530145771 None] Create snapshot completed successfully Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-641b3de9-5d7a-4bef-a64d-fdbc723b4961-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-641b3de9-5d7a-4bef-a64d-fdbc723b4961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-641b3de9-5d7a-4bef-a64d-fdbc723b4961" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-641b3de9-5d7a-4bef-a64d-fdbc723b4961" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Deleting offline snapshot 641b3de9-5d7a-4bef-a64d-fdbc723b4961 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] snapshot_file for this snap is: volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f0183-4d93-4771-915e-47deb97a33d8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:00 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 Aug 28 09:00:00 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:01 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a0825-5686-459b-9bb6-d4519487d1d0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:01 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:01 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:01 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:01 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 Aug 28 09:00:01 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:01 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961" returned: 0 in 0.414s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:01 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961 Aug 28 09:00:01 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:02 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.641b3de9-5d7a-4bef-a64d-fdbc723b4961" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-641b3de9-5d7a-4bef-a64d-fdbc723b4961" released by "_delete_snapshot" :: held 1.630s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_snapshot" :: held 1.654s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Created reservations ['cd094c59-c2f0-4b06-8c20-30edef071eb6', '662a9210-e018-4c89-9ae6-72ee92b15013', '2eea5216-8250-428f-8799-1fd27d54c506', '17c58b49-e4dd-4949-8eb5-77bffdcc2ed7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Delete snapshot completed successfully. Aug 28 09:00:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-25e05f4b-5edf-49d2-9b47-ff829aa5bf9f tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-641b3de9-5d7a-4bef-a64d-fdbc723b4961-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Creating offline snapshot 05a3a8b1-d55f-461d-8ff8-ec12038df612 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fad8bd-25c0-47c9-9f85-e21bbffb22fc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:03 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:03 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:03 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:03 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 1G Aug 28 09:00:03 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:03 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 1G" returned: 0 in 0.424s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:03 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 Aug 28 09:00:03 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:04 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:04 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 is being set with open permissions: ugo+rw Aug 28 09:00:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:04 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 Aug 28 09:00:04 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:04 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.489s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-59ff7eeb-cb28-4bd0-9c3d-2b1f4f4a68d6 tempest-SnapshotsActionsTest-530145771 None] Create snapshot completed successfully Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-05a3a8b1-d55f-461d-8ff8-ec12038df612-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-05a3a8b1-d55f-461d-8ff8-ec12038df612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-05a3a8b1-d55f-461d-8ff8-ec12038df612" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-05a3a8b1-d55f-461d-8ff8-ec12038df612" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Deleting offline snapshot 05a3a8b1-d55f-461d-8ff8-ec12038df612 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] snapshot_file for this snap is: volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7838db7f-47f3-4a24-ba73-182637655ba7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:05 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 Aug 28 09:00:05 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:05 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612" returned: 0 in 0.380s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac82abe-390a-4466-b1ca-a30f6a167143]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:05 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:05 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:06 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.369s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:06 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 Aug 28 09:00:06 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:06 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612" returned: 0 in 0.383s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:06 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612 Aug 28 09:00:06 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:06 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.05a3a8b1-d55f-461d-8ff8-ec12038df612" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-05a3a8b1-d55f-461d-8ff8-ec12038df612" released by "_delete_snapshot" :: held 1.527s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_snapshot" :: held 1.549s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Created reservations ['b22c0976-31ef-4dbf-8bf6-cc7046d11727', '22e16aa0-c68b-45e5-b377-9f660527dcd9', 'ecf04563-42ad-4a1c-b6e1-337fc3ffe98d', 'b5e134d9-db12-40e8-887f-faa3733128c6'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Delete snapshot completed successfully. Aug 28 09:00:06 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29f2d15c-3949-4fe1-997e-e19347fd8eaf tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-05a3a8b1-d55f-461d-8ff8-ec12038df612-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Creating offline snapshot 46365283-a64a-4fb1-8dce-2fc4831e6165 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:00:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3233370b-4749-417a-96d3-4e7fc267ebcc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:07 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:07 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:08 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:08 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 1G Aug 28 09:00:08 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:08 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 1G" returned: 0 in 0.523s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:08 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 Aug 28 09:00:08 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:09 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165" returned: 0 in 0.366s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:09 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 is being set with open permissions: ugo+rw Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:09 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 Aug 28 09:00:09 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:09 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.689s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c5c429b4-b9bf-4b9e-b9ef-b9559fffd41d tempest-SnapshotsActionsTest-530145771 None] Create snapshot completed successfully Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-46365283-a64a-4fb1-8dce-2fc4831e6165-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-46365283-a64a-4fb1-8dce-2fc4831e6165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Acquiring lock "cinder-quobyte-46365283-a64a-4fb1-8dce-2fc4831e6165" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-46365283-a64a-4fb1-8dce-2fc4831e6165" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Deleting offline snapshot 46365283-a64a-4fb1-8dce-2fc4831e6165 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] snapshot_file for this snap is: volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4331814f-8968-4e02-9914-820e65fffc0b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:10 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 Aug 28 09:00:10 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:10 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c735cdf-3af2-481d-bec3-3de5c0a168bf]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:10 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:10 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:10 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.391s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:10 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 Aug 28 09:00:10 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:11 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165" returned: 0 in 0.439s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:11 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165 Aug 28 09:00:11 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:11 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.46365283-a64a-4fb1-8dce-2fc4831e6165" returned: 0 in 0.254s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-46365283-a64a-4fb1-8dce-2fc4831e6165" released by "_delete_snapshot" :: held 1.600s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_snapshot" :: held 1.626s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Created reservations ['8ac11b38-812b-4abf-beda-6806e50aa898', '76de63a0-eb63-41a1-acd8-4ec576fa3da4', 'dd532110-0df2-496e-bbb7-af4ef5a34c54', '0e6e26b7-da1b-4e34-afd8-015a61fb638b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:11 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Delete snapshot completed successfully. Aug 28 09:00:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e0b546d9-60ce-4e5d-9b37-f6e1ac3436ad tempest-SnapshotsActionsTest-1389780193 None] Lock "cinder-46365283-a64a-4fb1-8dce-2fc4831e6165-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "cinder-79be036e-45f6-4323-9ac6-e2715934df13-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-79be036e-45f6-4323-9ac6-e2715934df13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "cinder-quobyte-79be036e-45f6-4323-9ac6-e2715934df13" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-79be036e-45f6-4323-9ac6-e2715934df13" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Deleting offline snapshot 79be036e-45f6-4323-9ac6-e2715934df13 of volume d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] snapshot_file for this snap is: volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e32151-8819-4230-8580-4743b28ce4fd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:12 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:12 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:13 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.396s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0231f4d-a637-4274-852d-700dcb901f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[82066beb-0a73-461a-9c9c-01056eaa0cd9]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:13 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 Aug 28 09:00:13 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:13 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70" returned: 0 in 0.373s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:13 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:13 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:13 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:13 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13 Aug 28 09:00:13 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:14 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70.79be036e-45f6-4323-9ac6-e2715934df13" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-79be036e-45f6-4323-9ac6-e2715934df13" released by "_delete_snapshot" :: held 1.528s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_snapshot" :: held 1.553s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Created reservations ['44fe6c10-1474-4e24-807b-e01ae6fe9645', '80687487-619d-4626-a395-b7f6d194b4d3', '4aa71843-122f-49e1-9f8a-1e264106e95f', 'a051f951-33ff-479b-a1e1-08dd2d5243fa'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Delete snapshot completed successfully. Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d88db187-9698-4f7a-9abf-ca30b44de2c0 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-79be036e-45f6-4323-9ac6-e2715934df13-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "cinder-d0231f4d-a637-4274-852d-700dcb901f70-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-d0231f4d-a637-4274-852d-700dcb901f70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" acquired by "delete_volume" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41bfe38-0d2c-46d5-9816-4ed4323db2ee]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:15 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 Aug 28 09:00:15 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:15 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:15 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70 Aug 28 09:00:15 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:15 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d0231f4d-a637-4274-852d-700dcb901f70" returned: 0 in 0.247s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-quobyte-d0231f4d-a637-4274-852d-700dcb901f70" released by "delete_volume" :: held 0.708s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Created reservations ['66f5700e-0b03-4c0b-aba0-2011b500f07d', 'a7535c4c-a237-463d-af0b-54da04faf31a', '8a56459c-b14b-4eb2-b1d3-d19628c8540b', '9ae3582e-8070-452e-ac26-8e1cb7f4bc7e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:15 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:00:15 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:15 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.246s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:00:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Deleted volume successfully. Aug 28 09:00:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1b1d687a-4644-4186-9a68-20763e5e3a07 tempest-SnapshotsActionsTest-530145771 None] Lock "cinder-d0231f4d-a637-4274-852d-700dcb901f70-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Flow 'volume_create_manager' (9bf13abc-2df6-4679-bf60-74711fe439f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c01cb3-0ebe-4203-b3e9-91d2c5ea2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c01cb3-0ebe-4203-b3e9-91d2c5ea2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1801880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5850661d-eb0b-4948-941e-123fbc964452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3070791e52394d15a8a1c35246518846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:00:30Z,use_quota=True,user_id='48422d0bded942d3aac024dd28bb9294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e14a957-4381-4047-8fd8-a684ff79fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e14a957-4381-4047-8fd8-a684ff79fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cffdd76-536a-406a-8fb5-190fe560a9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cffdd76-536a-406a-8fb5-190fe560a9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5850661d-eb0b-4948-941e-123fbc964452', 'volume_name': 'volume-5850661d-eb0b-4948-941e-123fbc964452', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34309a14-2ef5-4b7d-9ced-e306a0be36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34309a14-2ef5-4b7d-9ced-e306a0be36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b972a0b-cd16-4bd7-a57c-a4d25e4aba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Volume 5850661d-eb0b-4948-941e-123fbc964452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5850661d-eb0b-4948-941e-123fbc964452', 'volume_size': 1} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1801880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5850661d-eb0b-4948-941e-123fbc964452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3070791e52394d15a8a1c35246518846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:00:30Z,use_quota=True,user_id='48422d0bded942d3aac024dd28bb9294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Creating volume 5850661d-eb0b-4948-941e-123fbc964452 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:00:29 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:00:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:29 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 1073741824 Aug 28 09:00:29 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:30 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 1073741824" returned: 0 in 0.461s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:30 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 Aug 28 09:00:30 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:30 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b972a0b-cd16-4bd7-a57c-a4d25e4aba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5850661d-eb0b-4948-941e-123fbc964452', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c596b22-7e0f-4549-9503-ea5c6c3d5a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:00:30 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Volume volume-5850661d-eb0b-4948-941e-123fbc964452 (5850661d-eb0b-4948-941e-123fbc964452): created successfully Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c596b22-7e0f-4549-9503-ea5c6c3d5a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:00:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Flow 'volume_create_manager' (9bf13abc-2df6-4679-bf60-74711fe439f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:00:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c96699f4-1ffd-429b-9d99-ab152bfbaa93 tempest-VolumesServicesTestJSON-93495028 None] Created volume successfully. Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Acquiring lock "cinder-5850661d-eb0b-4948-941e-123fbc964452-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "cinder-5850661d-eb0b-4948-941e-123fbc964452-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Acquiring lock "cinder-quobyte-5850661d-eb0b-4948-941e-123fbc964452" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "cinder-quobyte-5850661d-eb0b-4948-941e-123fbc964452" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a4089-0977-4fce-aa6b-d9972cf0f4aa]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:32 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 Aug 28 09:00:32 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:32 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452" returned: 0 in 0.387s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:32 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452 Aug 28 09:00:32 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:32 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5850661d-eb0b-4948-941e-123fbc964452" returned: 0 in 0.274s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "cinder-quobyte-5850661d-eb0b-4948-941e-123fbc964452" released by "delete_volume" :: held 0.701s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:32 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Created reservations ['95ad3c19-fe23-4094-9940-da127e8c5c97', 'c457aa54-a4d0-46ee-9dea-cbb19eed1653', 'f121dde5-17d2-4fc5-92c8-6d57472576ee', '84a00778-2c90-4ce1-acfc-388eabfb6e89'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:33 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:00:33 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:33 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:00:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Deleted volume successfully. Aug 28 09:00:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e8e8c39a-f052-44cc-91ea-16da607b0fd1 tempest-VolumesServicesTestJSON-93495028 None] Lock "cinder-5850661d-eb0b-4948-941e-123fbc964452-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:00:40 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:00:40 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:00:40 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.284s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:00:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:00:43 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=49,cinder:INSERT=14,cinder:SELECT=53,cinder:DELETE=3 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:00:43 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=50,cinder:UPDATE=62,cinder:DELETE=6,cinder:INSERT=17 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (e91d4ee9-57c2-4e0c-af49-c3d007b8c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab6ce18-5f61-49e9-b8c1-1dd851410ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab6ce18-5f61-49e9-b8c1-1dd851410ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845090601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99af5dcc-424a-463e-bfaa-234dd9db4508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:21Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5a2055-79b5-4ce7-a18e-a1e7eeb53230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5a2055-79b5-4ce7-a18e-a1e7eeb53230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e15a769-aa8a-4307-b0a8-89f4fce800f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e15a769-aa8a-4307-b0a8-89f4fce800f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99af5dcc-424a-463e-bfaa-234dd9db4508', 'volume_name': 'volume-99af5dcc-424a-463e-bfaa-234dd9db4508', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d855266-d8aa-40b1-bae7-5356544b88a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d855266-d8aa-40b1-bae7-5356544b88a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23787b6c-71ac-4912-ace2-48738290ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Volume 99af5dcc-424a-463e-bfaa-234dd9db4508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99af5dcc-424a-463e-bfaa-234dd9db4508', 'volume_size': 1} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845090601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99af5dcc-424a-463e-bfaa-234dd9db4508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:21Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Creating volume 99af5dcc-424a-463e-bfaa-234dd9db4508 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:21 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:21 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 1073741824 Aug 28 09:01:21 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:21 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 1073741824" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:21 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 Aug 28 09:01:21 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:21 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508" returned: 0 in 0.355s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23787b6c-71ac-4912-ace2-48738290ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99af5dcc-424a-463e-bfaa-234dd9db4508', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343d36a-a794-4137-a561-ce94f7d5f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Volume volume-99af5dcc-424a-463e-bfaa-234dd9db4508 (99af5dcc-424a-463e-bfaa-234dd9db4508): created successfully Aug 28 09:01:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343d36a-a794-4137-a561-ce94f7d5f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (e91d4ee9-57c2-4e0c-af49-c3d007b8c803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-45a4109c-1f6f-4c67-bed8-62eb6c219c1e tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fdcc8e30-9119-47d3-8f7b-aa7c3104e5b5 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508" by "attach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fdcc8e30-9119-47d3-8f7b-aa7c3104e5b5 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508" acquired by "attach_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fdcc8e30-9119-47d3-8f7b-aa7c3104e5b5 tempest-VolumesActionsTest-1043071201 None] Attaching volume 99af5dcc-424a-463e-bfaa-234dd9db4508 to instance 107deff2-3c66-4c84-a4af-c49152141f17 at mountpoint /dev/vdb on host None. Aug 28 09:01:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fdcc8e30-9119-47d3-8f7b-aa7c3104e5b5 tempest-VolumesActionsTest-1043071201 None] Attach volume completed successfully. Aug 28 09:01:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fdcc8e30-9119-47d3-8f7b-aa7c3104e5b5 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508" released by "attach_volume" :: held 0.129s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Terminate volume connection completed successfully. Aug 28 09:01:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" by "detach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Detaching volume 99af5dcc-424a-463e-bfaa-234dd9db4508 from instance 107deff2-3c66-4c84-a4af-c49152141f17. Aug 28 09:01:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Detach volume completed successfully. Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-62475061-bd6f-46c6-9e68-7706c13e922a tempest-VolumesActionsTest-137040251 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a1a97fb6-111a-46b4-a60b-cec57a13fec8 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" by "detach_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a1a97fb6-111a-46b4-a60b-cec57a13fec8 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a1a97fb6-111a-46b4-a60b-cec57a13fec8 tempest-VolumesActionsTest-1043071201 None] Volume detach called, but volume not attached. Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a1a97fb6-111a-46b4-a60b-cec57a13fec8 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-quobyte-99af5dcc-424a-463e-bfaa-234dd9db4508" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-quobyte-99af5dcc-424a-463e-bfaa-234dd9db4508" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeee8ebc-0aa4-4b4d-b3d7-ad6f63741265]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:24 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 Aug 28 09:01:24 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:25 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:25 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508 Aug 28 09:01:25 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:25 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-99af5dcc-424a-463e-bfaa-234dd9db4508" returned: 0 in 0.253s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-quobyte-99af5dcc-424a-463e-bfaa-234dd9db4508" released by "delete_volume" :: held 0.719s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Created reservations ['a8c131f7-e9c2-415e-bc9e-738e9a8920ac', '4987cb9b-c077-41db-9d33-54acb590b85e', 'e1e973e3-8f08-4a17-8bcf-067aed87c839', 'f0f1f54f-077f-4496-a011-982a9413544c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:25 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:25 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:25 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Deleted volume successfully. Aug 28 09:01:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-55948f3c-be76-4fb0-9c75-e9811edfb3e4 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-99af5dcc-424a-463e-bfaa-234dd9db4508-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (884756e0-6165-4ea9-8ba4-b3c79aed8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c505f-d8c5-42d8-bab3-e4a9491451a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c505f-d8c5-42d8-bab3-e4a9491451a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449771851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e03bfcf-91d1-4984-9af8-0b061d3cb5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:29Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174c9416-024d-4384-95e3-41ed4208d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174c9416-024d-4384-95e3-41ed4208d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1b915-fd67-4c6c-9ad1-d47baa5fc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1b915-fd67-4c6c-9ad1-d47baa5fc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e03bfcf-91d1-4984-9af8-0b061d3cb5aa', 'volume_name': 'volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52817be4-978c-48cb-99b3-23c4dc466e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52817be4-978c-48cb-99b3-23c4dc466e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e263678-452a-4887-94de-1a604cda3ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Volume 3e03bfcf-91d1-4984-9af8-0b061d3cb5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa', 'volume_size': 1} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449771851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e03bfcf-91d1-4984-9af8-0b061d3cb5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:29Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Creating volume 3e03bfcf-91d1-4984-9af8-0b061d3cb5aa {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:29 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:29 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa 1073741824 Aug 28 09:01:29 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:29 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa 1073741824" returned: 0 in 0.444s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:29 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa Aug 28 09:01:29 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:29 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e263678-452a-4887-94de-1a604cda3ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519b7ea4-7ea9-4387-b64e-ea00ba4c52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Volume volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa (3e03bfcf-91d1-4984-9af8-0b061d3cb5aa): created successfully Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519b7ea4-7ea9-4387-b64e-ea00ba4c52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (884756e0-6165-4ea9-8ba4-b3c79aed8b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2a20e9a0-70c1-46eb-888e-6156bd8a3c1e tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "cinder-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-quobyte-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f7c351-45a0-484a-87d7-163b59de2425]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:30 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa Aug 28 09:01:30 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:30 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" returned: 0 in 0.370s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:30 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa Aug 28 09:01:30 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:30 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa" released by "delete_volume" :: held 0.658s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Created reservations ['af8184fd-2a4e-4918-9518-441202233a64', 'aaa2e36c-7b15-4da3-9cc9-91776b94d1b1', '41472bd3-7468-4464-ab07-bc5cde551d00', '5b8c7cbd-b6d0-403b-b527-9b0ab7acf855'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:30 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:30 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:31 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.265s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Deleted volume successfully. Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2f6ffef4-9fc9-4ff8-8cdc-635c5d0d2934 tempest-VolumesActionsTest-137040251 None] Lock "cinder-3e03bfcf-91d1-4984-9af8-0b061d3cb5aa-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (faadf8a6-785c-4c59-be7e-6f581d5c0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6fdf31-c6f3-4ed0-be8f-e17908eea468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6fdf31-c6f3-4ed0-be8f-e17908eea468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-71775729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eec6654-a0c3-4843-983c-267b923ca4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:32Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088bf17a-4c8f-4b0f-984b-fc09824829b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088bf17a-4c8f-4b0f-984b-fc09824829b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bc4553-19c9-493d-a788-8db8cbfc2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bc4553-19c9-493d-a788-8db8cbfc2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eec6654-a0c3-4843-983c-267b923ca4e8', 'volume_name': 'volume-7eec6654-a0c3-4843-983c-267b923ca4e8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271ef42-3892-4919-8e0b-8b8c18558a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271ef42-3892-4919-8e0b-8b8c18558a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d19b01-a144-4253-95cd-641d5386c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:31 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Volume 7eec6654-a0c3-4843-983c-267b923ca4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eec6654-a0c3-4843-983c-267b923ca4e8', 'volume_size': 1} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-71775729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eec6654-a0c3-4843-983c-267b923ca4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:32Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Creating volume 7eec6654-a0c3-4843-983c-267b923ca4e8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:31 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:31 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 1073741824 Aug 28 09:01:31 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:32 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 1073741824" returned: 0 in 0.491s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:32 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 Aug 28 09:01:32 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:32 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8" returned: 0 in 0.274s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d19b01-a144-4253-95cd-641d5386c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eec6654-a0c3-4843-983c-267b923ca4e8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a13035e-026a-4a48-adf8-813f2c2b9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Volume volume-7eec6654-a0c3-4843-983c-267b923ca4e8 (7eec6654-a0c3-4843-983c-267b923ca4e8): created successfully Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a13035e-026a-4a48-adf8-813f2c2b9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (faadf8a6-785c-4c59-be7e-6f581d5c0eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ebcd151c-096a-4b8c-a7bd-4f5dd6ebd8f5 tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-7eec6654-a0c3-4843-983c-267b923ca4e8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "cinder-7eec6654-a0c3-4843-983c-267b923ca4e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-quobyte-7eec6654-a0c3-4843-983c-267b923ca4e8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-7eec6654-a0c3-4843-983c-267b923ca4e8" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b504c4-6e7d-46d2-bbd6-86dd6e390777]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:34 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 Aug 28 09:01:34 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:34 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:34 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8 Aug 28 09:01:34 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:34 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-7eec6654-a0c3-4843-983c-267b923ca4e8" returned: 0 in 0.263s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-7eec6654-a0c3-4843-983c-267b923ca4e8" released by "delete_volume" :: held 0.712s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:34 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Created reservations ['bb2c1c4d-33cd-4aff-8183-db7cbb993ffa', 'dfa04576-1c32-46d6-9b4c-8827a8b7ba60', 'a5f7d207-bfc7-4169-9d8c-0fe9bb97719b', '80974d7b-072b-45f5-b941-6ba26f19eab7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:35 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:35 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:35 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:35 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Deleted volume successfully. Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-aa7b22b5-4f31-40f5-ab83-9591bc6b237f tempest-VolumesActionsTest-137040251 None] Lock "cinder-7eec6654-a0c3-4843-983c-267b923ca4e8-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (58031867-35af-4c73-bf22-85efc9ee120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0e2f0e-d751-414a-b091-c9c3dfbf2438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0e2f0e-d751-414a-b091-c9c3dfbf2438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664132434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a410b6-89b6-4f73-8b15-b0fbcb54ab97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:36Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee32e17-3162-40d9-b310-5a7900797feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee32e17-3162-40d9-b310-5a7900797feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9acae-18d1-47d9-b60c-8a98e3822d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9acae-18d1-47d9-b60c-8a98e3822d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a410b6-89b6-4f73-8b15-b0fbcb54ab97', 'volume_name': 'volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfce43f-8364-425d-a311-d2ba12f744d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfce43f-8364-425d-a311-d2ba12f744d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982da3a4-5240-44ef-848f-c3213a771582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:35 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Volume 82a410b6-89b6-4f73-8b15-b0fbcb54ab97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97', 'volume_size': 1} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-664132434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a410b6-89b6-4f73-8b15-b0fbcb54ab97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:36Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Creating volume 82a410b6-89b6-4f73-8b15-b0fbcb54ab97 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:35 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:35 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 1073741824 Aug 28 09:01:35 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:36 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 1073741824" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:36 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 Aug 28 09:01:36 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:36 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" returned: 0 in 0.257s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982da3a4-5240-44ef-848f-c3213a771582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3807211-ec2f-4491-8808-141d70d3a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:36 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Volume volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 (82a410b6-89b6-4f73-8b15-b0fbcb54ab97): created successfully Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3807211-ec2f-4491-8808-141d70d3a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (58031867-35af-4c73-bf22-85efc9ee120c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:36 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1607be49-322e-41cd-8151-a081805c083e tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-82a410b6-89b6-4f73-8b15-b0fbcb54ab97-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "cinder-82a410b6-89b6-4f73-8b15-b0fbcb54ab97-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-quobyte-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9246b21-f4b2-41c9-b640-7a85c177da51]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:37 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 Aug 28 09:01:37 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:37 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" returned: 0 in 0.401s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:37 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97 Aug 28 09:01:37 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:37 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" returned: 0 in 0.258s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-82a410b6-89b6-4f73-8b15-b0fbcb54ab97" released by "delete_volume" :: held 0.699s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Created reservations ['fcb108ef-827a-40aa-bc75-9620b7c00a34', '88579cd4-790b-4f1a-9464-7ff9da630091', '93963c61-240c-450e-bac5-b1221109157e', 'c6eada8b-89c1-44d8-bbea-29abe7e2ed00'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:37 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:37 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:38 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.287s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Deleted volume successfully. Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d95747c8-cb55-4f68-9768-8ac1c6ce31d3 tempest-VolumesActionsTest-137040251 None] Lock "cinder-82a410b6-89b6-4f73-8b15-b0fbcb54ab97-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (2253033e-d691-44ac-bbb3-774558656b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5a50e0-0236-45f6-bb75-c53621cd4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5a50e0-0236-45f6-bb75-c53621cd4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082954825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cc6ec7-2fae-4cbf-b12a-5b0831ff780d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:39Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb200f-8a58-497d-9fa4-81a0e5bc7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbb200f-8a58-497d-9fa4-81a0e5bc7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a21da3-bad0-4f3f-b124-18ebf4d6aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a21da3-bad0-4f3f-b124-18ebf4d6aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cc6ec7-2fae-4cbf-b12a-5b0831ff780d', 'volume_name': 'volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d65247-099d-46e3-9c5a-676c83ef320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d65247-099d-46e3-9c5a-676c83ef320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d5cdd4-724b-4414-991e-0f4e9708acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Volume 57cc6ec7-2fae-4cbf-b12a-5b0831ff780d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d', 'volume_size': 1} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082954825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cc6ec7-2fae-4cbf-b12a-5b0831ff780d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:39Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Creating volume 57cc6ec7-2fae-4cbf-b12a-5b0831ff780d {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:38 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:38 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d 1073741824 Aug 28 09:01:38 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:39 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d 1073741824" returned: 0 in 0.554s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:39 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d Aug 28 09:01:39 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:39 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d5cdd4-724b-4414-991e-0f4e9708acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc94605-6c69-45cc-8fdc-f7c34559c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Volume volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d (57cc6ec7-2fae-4cbf-b12a-5b0831ff780d): created successfully Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc94605-6c69-45cc-8fdc-f7c34559c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (2253033e-d691-44ac-bbb3-774558656b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:39 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8a92695f-4a9a-4d7b-b77b-b41b415227d1 tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:40 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:40 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:40 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.279s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "cinder-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Acquiring lock "cinder-quobyte-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbda7e-07d3-45a2-a536-c43c3ca54f57]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:41 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d Aug 28 09:01:41 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:41 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" returned: 0 in 0.393s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:41 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d Aug 28 09:01:41 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:41 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" returned: 0 in 0.278s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "cinder-quobyte-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d" released by "delete_volume" :: held 0.719s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Created reservations ['32a31ac1-c1d7-4af9-a416-4ea58729f51f', 'b015b4ab-90fe-4675-bdf9-4ff1329a17e1', '6625ba2a-83d4-403e-9750-cb5712a17e16', 'ced10287-3bbb-4743-82db-5b8f3468d983'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:41 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:41 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:42 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.285s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Deleted volume successfully. Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f0d4cd4b-82a1-4ffa-8335-a2c251856f98 tempest-VolumesActionsTest-137040251 None] Lock "cinder-57cc6ec7-2fae-4cbf-b12a-5b0831ff780d-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (31ab37b2-9237-40d0-840f-5b8033f8a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e939aa-4fb1-445d-b4f2-5cc52634e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e939aa-4fb1-445d-b4f2-5cc52634e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577453460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cbbd62-a99e-4ad9-8632-a5a181284d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:43Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075a8dfd-baaa-4a19-800e-48538d54b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075a8dfd-baaa-4a19-800e-48538d54b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1b6ba-1512-4741-9c1b-8f8cd9858532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1b6ba-1512-4741-9c1b-8f8cd9858532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cbbd62-a99e-4ad9-8632-a5a181284d14', 'volume_name': 'volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f3fa0b-d47d-4e0f-a4bd-ecb6d9a834aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f3fa0b-d47d-4e0f-a4bd-ecb6d9a834aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b502303-9fed-4595-ae9f-9fed2e4ce057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Volume a2cbbd62-a99e-4ad9-8632-a5a181284d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14', 'volume_size': 1} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577453460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cbbd62-a99e-4ad9-8632-a5a181284d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85469b40fe324610ad25972f286ed0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:01:43Z,use_quota=True,user_id='38b9c3d7d9c040a8b249a267e78f6130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Creating volume a2cbbd62-a99e-4ad9-8632-a5a181284d14 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:01:42 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:01:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:42 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 1073741824 Aug 28 09:01:42 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:43 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 1073741824" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:43 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 Aug 28 09:01:43 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:43 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14" returned: 0 in 0.241s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b502303-9fed-4595-ae9f-9fed2e4ce057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e219c6b3-d948-4158-bdf7-7d86b35fb8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:01:43 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Volume volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 (a2cbbd62-a99e-4ad9-8632-a5a181284d14): created successfully Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e219c6b3-d948-4158-bdf7-7d86b35fb8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:01:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Flow 'volume_create_manager' (31ab37b2-9237-40d0-840f-5b8033f8a71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:01:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-096382e3-45a8-4ff1-bb61-412fabae3302 tempest-VolumesActionsTest-1043071201 None] Created volume successfully. Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-a2cbbd62-a99e-4ad9-8632-a5a181284d14-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-a2cbbd62-a99e-4ad9-8632-a5a181284d14-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "cinder-quobyte-a2cbbd62-a99e-4ad9-8632-a5a181284d14" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-quobyte-a2cbbd62-a99e-4ad9-8632-a5a181284d14" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c343821-d7b9-4e9d-af8a-4d243ce7855c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:44 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 Aug 28 09:01:44 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:44 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:44 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14 Aug 28 09:01:44 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:44 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a2cbbd62-a99e-4ad9-8632-a5a181284d14" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-quobyte-a2cbbd62-a99e-4ad9-8632-a5a181284d14" released by "delete_volume" :: held 0.658s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Created reservations ['408879e9-fdf6-46cb-9128-9a335f1a7866', 'c32f18bb-c7b9-45a7-9d07-1a85115b1162', 'bc0d2781-8062-4445-b9a4-6bd3369f533b', '298e588c-8159-4503-a937-55419b973d69'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:01:45 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:01:45 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:01:45 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.292s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:01:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Deleted volume successfully. Aug 28 09:01:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-2e2becc6-c56f-4218-8c91-c9eb57c4b5d0 tempest-VolumesActionsTest-1043071201 None] Lock "cinder-a2cbbd62-a99e-4ad9-8632-a5a181284d14-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:01:55 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=55,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=13 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:01:55 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=70,cinder:SELECT=44,cinder:INSERT=19,cinder:DELETE=6 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:01:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:01:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Flow 'volume_create_manager' (6ed92fc4-e0bf-408b-94a2-7e4852f9aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b7c52-924d-4500-9a75-55b825bb4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b7c52-924d-4500-9a75-55b825bb4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1827086841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb69807-c3eb-4259-afb6-66b3c94b34da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b57d8b06e940108aa4fd575d1fd6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:00Z,use_quota=True,user_id='cf15484918d643e7a53c16fa0a47006f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3c843b-844e-4af4-81f2-a55a16d3eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3c843b-844e-4af4-81f2-a55a16d3eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c7efca-aac9-44f0-8759-7f9503e73f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c7efca-aac9-44f0-8759-7f9503e73f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb69807-c3eb-4259-afb6-66b3c94b34da', 'volume_name': 'volume-beb69807-c3eb-4259-afb6-66b3c94b34da', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635ca88f-90f2-4e3d-a752-9442c710fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635ca88f-90f2-4e3d-a752-9442c710fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c4114-df9f-474f-b320-3656e873c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Volume beb69807-c3eb-4259-afb6-66b3c94b34da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb69807-c3eb-4259-afb6-66b3c94b34da', 'volume_size': 1} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1827086841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb69807-c3eb-4259-afb6-66b3c94b34da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b57d8b06e940108aa4fd575d1fd6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:00Z,use_quota=True,user_id='cf15484918d643e7a53c16fa0a47006f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Creating volume beb69807-c3eb-4259-afb6-66b3c94b34da {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:00 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da 1073741824 Aug 28 09:02:00 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:00 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da 1073741824" returned: 0 in 0.438s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:00 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da Aug 28 09:02:00 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:00 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da" returned: 0 in 0.273s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c4114-df9f-474f-b320-3656e873c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb69807-c3eb-4259-afb6-66b3c94b34da', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460f448f-faee-4a27-aff5-3a3ec08473e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Volume volume-beb69807-c3eb-4259-afb6-66b3c94b34da (beb69807-c3eb-4259-afb6-66b3c94b34da): created successfully Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460f448f-faee-4a27-aff5-3a3ec08473e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Flow 'volume_create_manager' (6ed92fc4-e0bf-408b-94a2-7e4852f9aee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f3c975c7-31ec-406b-bca5-3c57118b6464 tempest-VolumesMetadataTest-2032718414 None] Created volume successfully. Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Acquiring lock "cinder-beb69807-c3eb-4259-afb6-66b3c94b34da-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "cinder-beb69807-c3eb-4259-afb6-66b3c94b34da-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Acquiring lock "cinder-quobyte-beb69807-c3eb-4259-afb6-66b3c94b34da" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "cinder-quobyte-beb69807-c3eb-4259-afb6-66b3c94b34da" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[04468b19-1ad0-4e4c-9d3a-98b8684f1fb9]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:01 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da Aug 28 09:02:01 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:02 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da" returned: 0 in 0.360s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:02 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da Aug 28 09:02:02 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:02 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-beb69807-c3eb-4259-afb6-66b3c94b34da" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "cinder-quobyte-beb69807-c3eb-4259-afb6-66b3c94b34da" released by "delete_volume" :: held 0.644s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Created reservations ['85c77026-409c-4ca1-baf0-166dfc685ee3', '19d781c9-34ab-4e68-8f2c-ca61933264b9', 'f043dab3-3666-4f42-b564-e7c34aaf600f', 'b5c5370e-810e-4977-aba0-773ce469be1e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:02 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:02 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:02 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.231s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Deleted volume successfully. Aug 28 09:02:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-42e34712-739a-4c53-ada7-45daf74d8d55 tempest-VolumesMetadataTest-2032718414 None] Lock "cinder-beb69807-c3eb-4259-afb6-66b3c94b34da-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (db12fcd0-7ea2-488e-b8c6-7d89b07ce31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a62247c-1f56-457f-80ec-14afc4f2d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a62247c-1f56-457f-80ec-14afc4f2d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-543023866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed761f95-b036-4e74-a760-6e0f60b46e1e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:06Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df94e60a-41c3-4653-bf3f-acd1cd183b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df94e60a-41c3-4653-bf3f-acd1cd183b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fd8cb2-c787-4532-bf1a-64116736eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fd8cb2-c787-4532-bf1a-64116736eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed761f95-b036-4e74-a760-6e0f60b46e1e', 'volume_name': 'volume-ed761f95-b036-4e74-a760-6e0f60b46e1e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9d3850-09cc-4c76-8e01-eb43bf47418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9d3850-09cc-4c76-8e01-eb43bf47418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a249d13-1cce-485b-8f78-e8aeedfe96fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Volume ed761f95-b036-4e74-a760-6e0f60b46e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed761f95-b036-4e74-a760-6e0f60b46e1e', 'volume_size': 1} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-543023866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed761f95-b036-4e74-a760-6e0f60b46e1e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:06Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Creating volume ed761f95-b036-4e74-a760-6e0f60b46e1e {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:05 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e 1073741824 Aug 28 09:02:05 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:06 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e 1073741824" returned: 0 in 0.484s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:06 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e Aug 28 09:02:06 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:06 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e" returned: 0 in 0.244s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a249d13-1cce-485b-8f78-e8aeedfe96fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed761f95-b036-4e74-a760-6e0f60b46e1e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee73ee9-0fd6-47b2-816a-c8545ea74e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Volume volume-ed761f95-b036-4e74-a760-6e0f60b46e1e (ed761f95-b036-4e74-a760-6e0f60b46e1e): created successfully Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee73ee9-0fd6-47b2-816a-c8545ea74e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (db12fcd0-7ea2-488e-b8c6-7d89b07ce31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c2b6353a-f037-4616-badd-5f29e3eb539d tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (a9a87823-5d2e-4d67-8901-d01e7e39873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5608c375-8f3c-4491-8186-869d3ba9191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5608c375-8f3c-4491-8186-869d3ba9191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-464255642',display_name='tempest-VolumesGetTest-Volume-1882473271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450140af-7f0f-4dbf-8599-4437a86ca714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:08Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e78594-235a-4359-ab53-573492cf0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e78594-235a-4359-ab53-573492cf0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10569a7f-9145-45c8-9c80-d4ecd55be187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10569a7f-9145-45c8-9c80-d4ecd55be187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '450140af-7f0f-4dbf-8599-4437a86ca714', 'volume_name': 'volume-450140af-7f0f-4dbf-8599-4437a86ca714', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b5580a-d8d6-4d98-896b-1601f81c7573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b5580a-d8d6-4d98-896b-1601f81c7573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335653c9-ea32-4f0e-904e-f838a6d661f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:08 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Volume 450140af-7f0f-4dbf-8599-4437a86ca714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-450140af-7f0f-4dbf-8599-4437a86ca714', 'volume_size': 1} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-464255642',display_name='tempest-VolumesGetTest-Volume-1882473271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450140af-7f0f-4dbf-8599-4437a86ca714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:08Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Creating volume 450140af-7f0f-4dbf-8599-4437a86ca714 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:08 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:08 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 1073741824 Aug 28 09:02:08 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:09 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 1073741824" returned: 0 in 0.482s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:09 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 Aug 28 09:02:09 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:09 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335653c9-ea32-4f0e-904e-f838a6d661f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450140af-7f0f-4dbf-8599-4437a86ca714', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c10d1c-4397-4c32-a9ad-632a6032bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Volume volume-450140af-7f0f-4dbf-8599-4437a86ca714 (450140af-7f0f-4dbf-8599-4437a86ca714): created successfully Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c10d1c-4397-4c32-a9ad-632a6032bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (a9a87823-5d2e-4d67-8901-d01e7e39873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eaf80685-6d1d-4b29-87a4-63cb05f4a6c9 tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-450140af-7f0f-4dbf-8599-4437a86ca714-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-450140af-7f0f-4dbf-8599-4437a86ca714-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-450140af-7f0f-4dbf-8599-4437a86ca714" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-450140af-7f0f-4dbf-8599-4437a86ca714" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c85416-c25c-4fdb-a600-5f1899471808]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:10 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 Aug 28 09:02:10 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:11 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714" returned: 0 in 0.411s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:11 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714 Aug 28 09:02:11 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:11 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-450140af-7f0f-4dbf-8599-4437a86ca714" returned: 0 in 0.244s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-450140af-7f0f-4dbf-8599-4437a86ca714" released by "delete_volume" :: held 0.701s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Created reservations ['77bf7e43-a02e-4660-a27e-71f34ac11c04', '7712cd56-a126-418a-b918-79cc516f447a', '8127b6db-5706-428a-92f6-534f47dbaae1', '87028a73-f2e9-4ee1-8fe3-f3bb9f7924d7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:11 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:11 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:11 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.270s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:11 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7bb21f06-db40-4b03-948c-1f88e42cafb5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-450140af-7f0f-4dbf-8599-4437a86ca714-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-ed761f95-b036-4e74-a760-6e0f60b46e1e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "cinder-ed761f95-b036-4e74-a760-6e0f60b46e1e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-ed761f95-b036-4e74-a760-6e0f60b46e1e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-ed761f95-b036-4e74-a760-6e0f60b46e1e" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696cd45-b5c5-4623-992e-d7c7ee583058]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:12 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e Aug 28 09:02:12 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:12 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:12 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e Aug 28 09:02:12 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:12 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed761f95-b036-4e74-a760-6e0f60b46e1e" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-ed761f95-b036-4e74-a760-6e0f60b46e1e" released by "delete_volume" :: held 0.685s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Created reservations ['de8e192e-1ec1-40af-a1a6-3e6cada9c78a', '3b7532d3-d9fa-43bf-b730-665a0f4a8677', 'f2939e8a-13ad-44cd-932e-72ba99532dd2', '23d4a80a-cb39-4559-82fc-bd70cc53d91c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:12 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:12 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:13 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.256s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-84a96e00-52f7-41a0-8bcd-06c234e9d64f tempest-VolumesGetTest-1311448314 None] Lock "cinder-ed761f95-b036-4e74-a760-6e0f60b46e1e-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (bd7de43d-61a1-4ea0-8259-ba9ba920bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0989e3c5-ae69-4a5d-ad8b-a44f53b6ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0989e3c5-ae69-4a5d-ad8b-a44f53b6ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435024073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d670ae-2e32-4ae7-9d27-4361cef14356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:14Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61d372-4460-4156-a7a9-67a234664c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61d372-4460-4156-a7a9-67a234664c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce5091e-e8f3-42ef-b166-95245d76d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce5091e-e8f3-42ef-b166-95245d76d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d670ae-2e32-4ae7-9d27-4361cef14356', 'volume_name': 'volume-62d670ae-2e32-4ae7-9d27-4361cef14356', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a51ddaa-653f-425e-9637-3925abe37071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a51ddaa-653f-425e-9637-3925abe37071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7d78e9-772e-4d7a-b337-d26417c734ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:13 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Volume 62d670ae-2e32-4ae7-9d27-4361cef14356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d670ae-2e32-4ae7-9d27-4361cef14356', 'volume_size': 1} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435024073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d670ae-2e32-4ae7-9d27-4361cef14356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:14Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Creating volume 62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:13 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:13 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 1073741824 Aug 28 09:02:13 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:14 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 1073741824" returned: 0 in 0.471s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:14 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:14 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:14 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7d78e9-772e-4d7a-b337-d26417c734ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d670ae-2e32-4ae7-9d27-4361cef14356', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e9487b-ce59-4af6-8139-156efd7d631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Volume volume-62d670ae-2e32-4ae7-9d27-4361cef14356 (62d670ae-2e32-4ae7-9d27-4361cef14356): created successfully Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e9487b-ce59-4af6-8139-156efd7d631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (bd7de43d-61a1-4ea0-8259-ba9ba920bba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2ce086f8-2f85-4766-a0fe-146226b6fab1 tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (3ce5456d-fce9-47a9-b377-a216fa0f65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378d0efc-410a-4695-9f4d-c26269146e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378d0efc-410a-4695-9f4d-c26269146e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901554393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13827ff-2a05-4b0c-80a7-327188fbdfa5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=62d670ae-2e32-4ae7-9d27-4361cef14356,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:16Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc27329-51e4-4142-be6b-c7b89111d698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc27329-51e4-4142-be6b-c7b89111d698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f1f90f-b46b-4a5d-9f8e-b0a169535fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f1f90f-b46b-4a5d-9f8e-b0a169535fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f13827ff-2a05-4b0c-80a7-327188fbdfa5', 'volume_name': 'volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5', 'volume_size': 1, 'source_volid': '62d670ae-2e32-4ae7-9d27-4361cef14356', 'source_volstatus': 'available'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c053f7-3074-48f9-b084-3c94b6ffac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c053f7-3074-48f9-b084-3c94b6ffac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fc165d-45d5-4c26-bb35-afd8d83cfc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Volume f13827ff-2a05-4b0c-80a7-327188fbdfa5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5', 'volume_size': 1, 'source_volid': '62d670ae-2e32-4ae7-9d27-4361cef14356', 'source_volstatus': 'available'} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:16 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Cloning volume 62d670ae-2e32-4ae7-9d27-4361cef14356 to volume f13827ff-2a05-4b0c-80a7-327188fbdfa5 Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Creating offline snapshot f6d0898b-ef74-48d1-85d9-ae89fefe5cfb of volume 62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4267594-b4e4-435a-bb6a-baffcf14ce2c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:16 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:16 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:16 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.374s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:16 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb 1G Aug 28 09:02:16 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:17 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb 1G" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d670ae-2e32-4ae7-9d27-4361cef14356 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:17 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d670ae-2e32-4ae7-9d27-4361cef14356 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:17 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:17 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62d670ae-2e32-4ae7-9d27-4361cef14356 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:17 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb is being set with open permissions: ugo+rw Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:17 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:17 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:17 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:17 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info Aug 28 09:02:17 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:18 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info" returned: 0 in 0.254s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:18 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info is being set with open permissions: ugo+rw Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:18 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info Aug 28 09:02:18 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:18 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.info" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] snapshot: f6d0898b-ef74-48d1-85d9-ae89fefe5cfb, volume: f13827ff-2a05-4b0c-80a7-327188fbdfa5, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775e7c7-8861-4feb-815c-b02fb8d62cec]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:18 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:18 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:18 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d670ae-2e32-4ae7-9d27-4361cef14356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c652da0-7024-4df7-93b2-8331d96453f8]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:18 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:18 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:19 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:02:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:02:19 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:02:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:19 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 Aug 28 09:02:19 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:23 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5" returned: 0 in 4.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:02:23 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Converted 1024.00 MB image at 233.88 MB/s Aug 28 09:02:23 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 is being set with open permissions: ugo+rw Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:23 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 Aug 28 09:02:23 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:23 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5" returned: 0 in 0.262s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" released by "_copy_volume_from_snapshot" :: held 5.405s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Deleting offline snapshot f6d0898b-ef74-48d1-85d9-ae89fefe5cfb of volume 62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] snapshot_file for this snap is: volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4fdd2f-532d-44bc-8c44-4ce0fc22e667]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:23 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:23 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:24 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.376s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62d670ae-2e32-4ae7-9d27-4361cef14356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[837bc730-fde4-4783-96fe-fefc20efcaac]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:24 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:24 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:24 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.611s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:24 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:24 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:25 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.369s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:25 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb Aug 28 09:02:25 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:25 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356.f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f6d0898b-ef74-48d1-85d9-ae89fefe5cfb" released by "_delete_snapshot" :: held 1.717s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.149s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fc165d-45d5-4c26-bb35-afd8d83cfc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5', 'volume_size': 1, 'source_volid': '62d670ae-2e32-4ae7-9d27-4361cef14356', 'source_volstatus': 'available'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fdc733-5edc-4506-b9c5-ecee0340c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:25 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Volume volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 (f13827ff-2a05-4b0c-80a7-327188fbdfa5): created successfully Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fdc733-5edc-4506-b9c5-ecee0340c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:25 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (3ce5456d-fce9-47a9-b377-a216fa0f65ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d1b4cabc-d329-4614-b16a-7da96a2f7711 tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:26 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (370528eb-bfc8-4046-9185-2cfb3cbf0e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17122ab4-330f-4bd6-9f1e-78d77da9322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17122ab4-330f-4bd6-9f1e-78d77da9322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2063723692',display_name='tempest-VolumesGetTest-Volume-2127076529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b67b0-a2eb-4ed5-b38a-fa8f8a88c552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:27Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a61566-4f8f-402c-8115-86f56a61e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a61566-4f8f-402c-8115-86f56a61e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99634987-a50f-482b-bba2-2d264016a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99634987-a50f-482b-bba2-2d264016a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938b67b0-a2eb-4ed5-b38a-fa8f8a88c552', 'volume_name': 'volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597727a7-be46-498a-8552-400306f382c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597727a7-be46-498a-8552-400306f382c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3165a2ea-0d1e-4a34-9b58-00e55d3bdb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Volume 938b67b0-a2eb-4ed5-b38a-fa8f8a88c552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552', 'volume_size': 1} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2063723692',display_name='tempest-VolumesGetTest-Volume-2127076529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b67b0-a2eb-4ed5-b38a-fa8f8a88c552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:27Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Creating volume 938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:27 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:27 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 1073741824 Aug 28 09:02:27 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:27 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 1073741824" returned: 0 in 0.453s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:27 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 Aug 28 09:02:27 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:27 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3165a2ea-0d1e-4a34-9b58-00e55d3bdb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66772ab0-d8f9-4ac6-bc62-22a151e3302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Volume volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 (938b67b0-a2eb-4ed5-b38a-fa8f8a88c552): created successfully Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66772ab0-d8f9-4ac6-bc62-22a151e3302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (370528eb-bfc8-4046-9185-2cfb3cbf0e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-577ac858-af41-4b71-9188-80ad48a1f6ae tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "cinder-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[195fa474-05c0-4d63-aa07-301a70b2b49e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:28 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 Aug 28 09:02:28 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:28 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:28 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552 Aug 28 09:02:28 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:28 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" returned: 0 in 0.274s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552" released by "delete_volume" :: held 0.668s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Created reservations ['54d5cf55-073f-40e2-a429-e6d0d5334948', '534dcd07-2abf-4f24-ba11-c6d221f6bc05', '40ec8d8f-6eb0-45fe-a78d-6f1ec4d654b1', '9f67149f-8c94-44a3-84c9-bac82890ab19'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:28 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:28 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:29 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.261s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a894e728-2f4a-4ddd-94de-0f4a3c934005 tempest-VolumesGetTest-1311448314 None] Lock "cinder-938b67b0-a2eb-4ed5-b38a-fa8f8a88c552-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-f13827ff-2a05-4b0c-80a7-327188fbdfa5-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-f13827ff-2a05-4b0c-80a7-327188fbdfa5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8de1cb-46d8-45e1-a157-6df3d55da2c3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:29 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 Aug 28 09:02:29 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:29 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5" returned: 0 in 0.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:29 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5 Aug 28 09:02:29 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:30 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f13827ff-2a05-4b0c-80a7-327188fbdfa5" returned: 0 in 0.238s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-f13827ff-2a05-4b0c-80a7-327188fbdfa5" released by "delete_volume" :: held 0.647s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Created reservations ['4bc58ed0-7f9b-4bb3-abd0-1243f0fcc7c4', '118ccbab-72a1-46ff-b1a3-29d36bfc8dfc', '9a21bc8c-4953-402e-b20b-30dc29de20ee', '6fc756a7-f8ce-4d7e-aad8-14be8065da34'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:30 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:30 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:30 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.244s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3a3dc003-d6a6-4347-8b48-3998e42446b5 tempest-VolumesGetTest-1311448314 None] Lock "cinder-f13827ff-2a05-4b0c-80a7-327188fbdfa5-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-62d670ae-2e32-4ae7-9d27-4361cef14356-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "cinder-62d670ae-2e32-4ae7-9d27-4361cef14356-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-62d670ae-2e32-4ae7-9d27-4361cef14356" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-62d670ae-2e32-4ae7-9d27-4361cef14356" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec1228-95c2-4fdb-84e1-0c963eff4f0c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:30 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:30 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:31 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.365s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:31 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356 Aug 28 09:02:31 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:31 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-62d670ae-2e32-4ae7-9d27-4361cef14356" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-62d670ae-2e32-4ae7-9d27-4361cef14356" released by "delete_volume" :: held 0.716s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Created reservations ['9a6d8102-c788-48cb-a5cf-d140b8ff747d', 'fe1d114b-2d36-4537-b264-69e40c6bebcb', '9b9129a7-f1d3-4a16-8db6-2502053b426b', 'd86d83c4-ddda-46e8-850f-bf1f09f8718b'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:31 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:31 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:31 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-775f6945-7190-494e-8b10-e18aecb942cf tempest-VolumesGetTest-1311448314 None] Lock "cinder-62d670ae-2e32-4ae7-9d27-4361cef14356-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (43066847-a2ea-40f0-a5e6-4f53e8581efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b259f075-7b03-469b-8475-f09a45b3a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b259f075-7b03-469b-8475-f09a45b3a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861393161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e3bb1b-079a-4a03-943a-035d1b69d734,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:33Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb913a-e60e-4ae3-863b-448762690765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb913a-e60e-4ae3-863b-448762690765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1a7cdb-4a33-4f3f-99a1-4ba0fc0c01ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1a7cdb-4a33-4f3f-99a1-4ba0fc0c01ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3e3bb1b-079a-4a03-943a-035d1b69d734', 'volume_name': 'volume-b3e3bb1b-079a-4a03-943a-035d1b69d734', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c906dfa-5b44-4df0-ac73-7e9593a4e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c906dfa-5b44-4df0-ac73-7e9593a4e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2059cc41-f29c-4e04-a50d-37660e0b1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Volume b3e3bb1b-079a-4a03-943a-035d1b69d734: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3e3bb1b-079a-4a03-943a-035d1b69d734', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:02:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Trying to clone b3e3bb1b-079a-4a03-943a-035d1b69d734 from image f08659ba-d34f-40d3-9342-92af7297d5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:02:33 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb47f3-3aba-4fe3-a89f-fa4cf8562db5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:33 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD Aug 28 09:02:33 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:33 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 is fetched for user 1adc3b8c30034860ac3e9d1f8b1e75eb. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfba48c-5988-4537-9f6a-2e3a42303c5e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:33 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD Aug 28 09:02:33 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:34 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861393161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e3bb1b-079a-4a03-943a-035d1b69d734,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:33Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Creating volume b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:34 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:34 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1073741824 Aug 28 09:02:34 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:34 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1073741824" returned: 0 in 0.508s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:34 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 Aug 28 09:02:34 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:34 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Attempting download of f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume b3e3bb1b-079a-4a03-943a-035d1b69d734. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc3c559-4656-4b4d-91b2-b5ff0dcf3dab]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:35 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1 Aug 28 09:02:35 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:35 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1" returned: 0 in 0.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:35 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1 Aug 28 09:02:35 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:35 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1" returned: 1 in 0.353s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_6o3_bz_1' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b20d5-071c-4018-90b4-483667098ade]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:35 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD Aug 28 09:02:35 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:36 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:36 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] f08659ba-d34f-40d3-9342-92af7297d5d7 was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:02:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:36 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 Aug 28 09:02:36 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:37 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734" returned: 0 in 1.686s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:37 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_v28__bfrdevstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:02:37 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Converted 112.00 MB image at 66.39 MB/s Aug 28 09:02:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:37 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1G Aug 28 09:02:37 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:38 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 1G" returned: 0 in 0.365s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Downloaded image f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume b3e3bb1b-079a-4a03-943a-035d1b69d734 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 for user 1adc3b8c30034860ac3e9d1f8b1e75eb is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Marking volume b3e3bb1b-079a-4a03-943a-035d1b69d734 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Copying metadata from image f08659ba-d34f-40d3-9342-92af7297d5d7 to b3e3bb1b-079a-4a03-943a-035d1b69d734. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Creating volume glance metadata for volume b3e3bb1b-079a-4a03-943a-035d1b69d734 backed by image f08659ba-d34f-40d3-9342-92af7297d5d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2059cc41-f29c-4e04-a50d-37660e0b1704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e3bb1b-079a-4a03-943a-035d1b69d734', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df4288c-c031-4104-a1e3-36160081e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Volume volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 (b3e3bb1b-079a-4a03-943a-035d1b69d734): created successfully Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df4288c-c031-4104-a1e3-36160081e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (43066847-a2ea-40f0-a5e6-4f53e8581efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ba7f36fd-8339-4d04-b50b-68ee9cd592c8 tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (eb41d077-988d-40cc-8243-f0c22429fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7466600f-fb95-49ac-ab19-08e5e1aed9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7466600f-fb95-49ac-ab19-08e5e1aed9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1431285982',display_name='tempest-VolumesGetTest-Volume-1647631781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a6949f-1046-4892-8db2-98ecd8d7225c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:40Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098cc69f-3583-4ae4-ba4a-05dbcff8086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098cc69f-3583-4ae4-ba4a-05dbcff8086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1020d09e-ae29-448c-b995-d6920fb86da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1020d09e-ae29-448c-b995-d6920fb86da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a6949f-1046-4892-8db2-98ecd8d7225c', 'volume_name': 'volume-86a6949f-1046-4892-8db2-98ecd8d7225c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e8d722-0e2a-49e6-a4c4-18f57fa6f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e8d722-0e2a-49e6-a4c4-18f57fa6f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3fe27b-c19e-4837-b85e-88a83b88847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:39 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Volume 86a6949f-1046-4892-8db2-98ecd8d7225c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a6949f-1046-4892-8db2-98ecd8d7225c', 'volume_size': 1} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1431285982',display_name='tempest-VolumesGetTest-Volume-1647631781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a6949f-1046-4892-8db2-98ecd8d7225c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39173cf629fc4aba87fff5946ba9f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:40Z,use_quota=True,user_id='1adc3b8c30034860ac3e9d1f8b1e75eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Creating volume 86a6949f-1046-4892-8db2-98ecd8d7225c {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:39 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:39 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c 1073741824 Aug 28 09:02:39 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:40 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c 1073741824" returned: 0 in 0.418s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:40 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c Aug 28 09:02:40 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:40 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:40 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:40 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3fe27b-c19e-4837-b85e-88a83b88847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a6949f-1046-4892-8db2-98ecd8d7225c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01bef9-5bc7-467f-97aa-a18247777ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Volume volume-86a6949f-1046-4892-8db2-98ecd8d7225c (86a6949f-1046-4892-8db2-98ecd8d7225c): created successfully Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01bef9-5bc7-467f-97aa-a18247777ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Flow 'volume_create_manager' (eb41d077-988d-40cc-8243-f0c22429fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1c797094-3497-4835-80ef-8dcd5002d536 tempest-VolumesGetTest-1311448314 None] Created volume successfully. Aug 28 09:02:40 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.292s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-86a6949f-1046-4892-8db2-98ecd8d7225c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "cinder-86a6949f-1046-4892-8db2-98ecd8d7225c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-86a6949f-1046-4892-8db2-98ecd8d7225c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-86a6949f-1046-4892-8db2-98ecd8d7225c" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[960afce8-27c1-4137-8d5d-ba191f86bf45]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:41 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c Aug 28 09:02:41 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:41 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c" returned: 0 in 0.366s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:41 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c Aug 28 09:02:41 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:41 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-86a6949f-1046-4892-8db2-98ecd8d7225c" returned: 0 in 0.265s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-86a6949f-1046-4892-8db2-98ecd8d7225c" released by "delete_volume" :: held 0.674s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Created reservations ['bfd1b0f5-5dfb-481d-9454-43d2cf60b11d', 'b4e69133-a436-4339-ac00-d1746769bd52', '937c3909-56a5-431a-88b1-2ebb320b18b4', '630124a1-5d8e-462b-ac54-ae4c527c0e6f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:41 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:41 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:42 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-556c1985-3040-4bbb-8b5f-83f1700b77fc tempest-VolumesGetTest-1311448314 None] Lock "cinder-86a6949f-1046-4892-8db2-98ecd8d7225c-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-b3e3bb1b-079a-4a03-943a-035d1b69d734-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "cinder-b3e3bb1b-079a-4a03-943a-035d1b69d734-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Acquiring lock "cinder-quobyte-b3e3bb1b-079a-4a03-943a-035d1b69d734" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-b3e3bb1b-079a-4a03-943a-035d1b69d734" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad055e6-6e0b-410a-b49f-ea4f3df6d7e5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:42 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 Aug 28 09:02:42 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:42 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734" returned: 0 in 0.363s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:42 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734 Aug 28 09:02:42 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:42 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b3e3bb1b-079a-4a03-943a-035d1b69d734" returned: 0 in 0.256s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "cinder-quobyte-b3e3bb1b-079a-4a03-943a-035d1b69d734" released by "delete_volume" :: held 0.657s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:42 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Created reservations ['1caf01de-8d66-44e0-9940-f49d722a153c', 'e4ca6cc4-0d4b-4ef1-ae95-3cc0f2291eeb', 'fe34ea16-a8a4-4ceb-a3f9-57824dbefd6a', '7cf72bd9-db00-45e5-9859-743bae355181'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:43 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:02:43 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:43 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:02:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Deleted volume successfully. Aug 28 09:02:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3225dc9c-101f-479d-b9c2-b2d53904b497 tempest-VolumesGetTest-1311448314 None] Lock "cinder-b3e3bb1b-079a-4a03-943a-035d1b69d734-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Flow 'volume_create_manager' (1c19d460-f4b8-47ea-a13b-d9006716bfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9af26e6-25cb-4266-be76-898ea646cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9af26e6-25cb-4266-be76-898ea646cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-890752766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdbb267-885a-4a54-a5f8-1549c74cd5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ccdf5c878914b26b7dcd3392ea2cde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:46Z,use_quota=True,user_id='42422d89585445698e978c5d69a1e1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e241c66-6ec1-4617-ab77-274c98953b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e241c66-6ec1-4617-ab77-274c98953b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e38e2-7d3a-4893-b30b-d72ad96c6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e38e2-7d3a-4893-b30b-d72ad96c6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdbb267-885a-4a54-a5f8-1549c74cd5f8', 'volume_name': 'volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02d9f9-6915-4329-b819-d0e02c77b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec02d9f9-6915-4329-b819-d0e02c77b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb35f0ab-2e00-4246-9898-8f5c5a488533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8', 'volume_size': 1} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-890752766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdbb267-885a-4a54-a5f8-1549c74cd5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ccdf5c878914b26b7dcd3392ea2cde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:02:46Z,use_quota=True,user_id='42422d89585445698e978c5d69a1e1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Creating volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:02:46 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:46 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 1073741824 Aug 28 09:02:46 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:46 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 1073741824" returned: 0 in 0.431s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:46 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 Aug 28 09:02:46 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:46 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" returned: 0 in 0.241s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb35f0ab-2e00-4246-9898-8f5c5a488533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a7199c-19f6-4eae-a4be-1dc66c375263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:02:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Volume volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 (ebdbb267-885a-4a54-a5f8-1549c74cd5f8): created successfully Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a7199c-19f6-4eae-a4be-1dc66c375263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Flow 'volume_create_manager' (1c19d460-f4b8-47ea-a13b-d9006716bfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:02:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-59c1fb93-55ea-4cfe-ba92-24bbb678b60a tempest-VolumesSnapshotListTestJSON-524628978 None] Created volume successfully. Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Creating offline snapshot 615f0d65-f293-4661-bbcc-e021b7ef6cce of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[80256e1a-18ba-474c-b15d-c99e9ebb205c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:47 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 Aug 28 09:02:47 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:47 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" returned: 0 in 0.378s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:47 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce 1G Aug 28 09:02:47 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:48 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce 1G" returned: 0 in 0.391s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:48 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:48 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:48 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:48 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce is being set with open permissions: ugo+rw Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:48 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:48 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:48 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.269s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:48 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info Aug 28 09:02:48 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:49 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:49 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info is being set with open permissions: ugo+rw Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:49 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info Aug 28 09:02:49 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:49 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.info" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3083a16b-a297-45b7-bb66-2f7c7b9f5fb6 tempest-VolumesSnapshotListTestJSON-524628978 None] Create snapshot completed successfully Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Creating offline snapshot 91408ab2-9739-4cfc-b7a4-efcca6bb6d80 of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[214862c2-e4fd-4bf2-b53f-ad395eddf631]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:49 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:49 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:50 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.392s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:50 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 1G Aug 28 09:02:50 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:50 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 1G" returned: 0 in 0.404s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:50 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:50 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:50 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:50 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 is being set with open permissions: ugo+rw Aug 28 09:02:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:50 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:50 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:51 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.238s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.412s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b54c34de-7fcb-4c2d-bec7-7510af97b120 tempest-VolumesSnapshotListTestJSON-524628978 None] Create snapshot completed successfully Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Creating offline snapshot ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b70a51-04fb-436f-97ef-d2896d3a0483]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:52 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:52 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:52 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.366s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:52 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e 1G Aug 28 09:02:52 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:52 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e 1G" returned: 0 in 0.457s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:52 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e Aug 28 09:02:52 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:53 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:53 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e is being set with open permissions: ugo+rw Aug 28 09:02:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:53 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e Aug 28 09:02:53 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:53 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" returned: 0 in 0.238s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.437s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:02:53 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-321c5936-7cf0-4fa0-8226-4b70bfb15753 tempest-VolumesSnapshotListTestJSON-524628978 None] Create snapshot completed successfully Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Deleting offline snapshot ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] snapshot_file for this snap is: volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b3bd7-fcbd-476c-a09d-78474b1095dd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:54 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e Aug 28 09:02:54 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:55 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" returned: 0 in 0.361s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eee992-3ebb-4a90-ad46-444bfad6814d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:55 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:55 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:55 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:55 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e Aug 28 09:02:55 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:56 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" returned: 0 in 0.416s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:56 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e Aug 28 09:02:56 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:56 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e" released by "_delete_snapshot" :: held 1.479s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" released by "delete_snapshot" :: held 1.501s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=74,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=11 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=97,cinder:SELECT=83,cinder:INSERT=30,cinder:DELETE=9 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Created reservations ['0d0cc99f-ba1a-40e3-b322-a14d9003b135', 'b489da5a-4e42-49a0-a044-1e24bf4ac9e2', '839cf0e9-5283-429c-a0e3-484d14f41dfd', 'e2c3af11-88a5-40bc-9962-beeba67e21c4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Delete snapshot completed successfully. Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ee0fea3b-86ca-463c-add9-dac8e270dad8 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-ccd945da-6f87-4d1d-8f3b-11bf4ea2fe5e-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-91408ab2-9739-4cfc-b7a4-efcca6bb6d80-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-91408ab2-9739-4cfc-b7a4-efcca6bb6d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-91408ab2-9739-4cfc-b7a4-efcca6bb6d80" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-91408ab2-9739-4cfc-b7a4-efcca6bb6d80" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Deleting offline snapshot 91408ab2-9739-4cfc-b7a4-efcca6bb6d80 of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] snapshot_file for this snap is: volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc7dbb3-f02d-44ab-ba2d-740be46d97c7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:57 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:57 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:57 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d926e-aa51-4c94-9bc1-1bbeb398ba47]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:57 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:57 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:57 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:57 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:57 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:58 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:58 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80 Aug 28 09:02:58 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:58 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.91408ab2-9739-4cfc-b7a4-efcca6bb6d80" returned: 0 in 0.247s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-91408ab2-9739-4cfc-b7a4-efcca6bb6d80" released by "_delete_snapshot" :: held 1.405s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" released by "delete_snapshot" :: held 1.427s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Created reservations ['bb2658cd-2e79-4d6b-921c-efa2669c9d3a', '94cdf347-5e76-4c97-ab63-c1ea39fc4e85', 'da8cb286-d7fc-46ae-9e65-22ba58b88e1b', '66830d16-4463-4e6c-8bd2-ed8588431249'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:02:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Delete snapshot completed successfully. Aug 28 09:02:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c72a73b9-5339-44c4-986f-b3c68d80ecc5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-91408ab2-9739-4cfc-b7a4-efcca6bb6d80-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-615f0d65-f293-4661-bbcc-e021b7ef6cce-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-615f0d65-f293-4661-bbcc-e021b7ef6cce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-615f0d65-f293-4661-bbcc-e021b7ef6cce" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-615f0d65-f293-4661-bbcc-e021b7ef6cce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Deleting offline snapshot 615f0d65-f293-4661-bbcc-e021b7ef6cce of volume ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] snapshot_file for this snap is: volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ec957-2cd0-453a-a960-7e88ab36eb3e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:59 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:59 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:59 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02dad07-fde4-4878-b122-a7f6999c0dc2]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:59 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 Aug 28 09:02:59 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:02:59 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" returned: 0 in 0.350s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:02:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:02:59 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:02:59 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:00 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:00 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce Aug 28 09:03:00 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:00 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8.615f0d65-f293-4661-bbcc-e021b7ef6cce" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-615f0d65-f293-4661-bbcc-e021b7ef6cce" released by "_delete_snapshot" :: held 1.437s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" released by "delete_snapshot" :: held 1.461s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Created reservations ['4caa9daa-254b-4d34-9b2c-742dda0b7452', 'c1feeaf8-64cb-4993-b3e5-f24798931a35', 'f71f548b-6bc2-49ff-83a9-aeb4286bd9cf', 'f8e9bce1-7e67-4024-98e1-458b1404b3e8'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:03:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Delete snapshot completed successfully. Aug 28 09:03:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bcf4acac-8de8-4c18-88db-dea8880a1ef5 tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-615f0d65-f293-4661-bbcc-e021b7ef6cce-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-ebdbb267-885a-4a54-a5f8-1549c74cd5f8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-ebdbb267-885a-4a54-a5f8-1549c74cd5f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" acquired by "delete_volume" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b18667-018f-4c13-9119-1b74422dbc57]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:01 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 Aug 28 09:03:01 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:01 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:01 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8 Aug 28 09:03:01 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:02 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" returned: 0 in 0.254s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-quobyte-ebdbb267-885a-4a54-a5f8-1549c74cd5f8" released by "delete_volume" :: held 0.664s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Created reservations ['30b310fd-d54d-4d81-9ab1-95b648734acd', '64ba9eed-1d1d-45b7-b0a8-59325a8776a9', 'f7e2958c-f975-48ff-9dd1-05cb0995758d', 'd4ccbda7-b3af-45ae-957a-61dc52bb099c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:02 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:03:02 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:02 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.262s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:03:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Deleted volume successfully. Aug 28 09:03:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e1f945bb-9e3b-4192-88e4-ace16675d19c tempest-VolumesSnapshotListTestJSON-524628978 None] Lock "cinder-ebdbb267-885a-4a54-a5f8-1549c74cd5f8-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:03:12 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:INSERT=12,cinder:UPDATE=26,cinder:SELECT=15 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:03:12 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Flow 'volume_create_manager' (e692d979-fb57-47cc-81e6-259b88f25624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1c73d-889c-4bbd-a93e-79ee1b60a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1c73d-889c-4bbd-a93e-79ee1b60a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1971412467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef407b2-ede0-4782-abee-92d2307b69c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392bddb0da3d4b67b77940ae63ac68d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:03:37Z,use_quota=True,user_id='086f73c2c03441d690ce8bf404f84e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a198bdf5-f8a1-4e87-a80e-5b97d4bd5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a198bdf5-f8a1-4e87-a80e-5b97d4bd5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c14f3fb-9caa-44c4-b19d-05a74ae4d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c14f3fb-9caa-44c4-b19d-05a74ae4d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef407b2-ede0-4782-abee-92d2307b69c8', 'volume_name': 'volume-6ef407b2-ede0-4782-abee-92d2307b69c8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63d838-2273-4797-8334-b1f33fedfc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63d838-2273-4797-8334-b1f33fedfc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e999d77-53ef-454d-8b11-794ab4d4fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:37 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Volume 6ef407b2-ede0-4782-abee-92d2307b69c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef407b2-ede0-4782-abee-92d2307b69c8', 'volume_size': 1} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1971412467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef407b2-ede0-4782-abee-92d2307b69c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392bddb0da3d4b67b77940ae63ac68d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:03:37Z,use_quota=True,user_id='086f73c2c03441d690ce8bf404f84e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Creating volume 6ef407b2-ede0-4782-abee-92d2307b69c8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:03:37 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:37 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 1073741824 Aug 28 09:03:37 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:37 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 1073741824" returned: 0 in 0.515s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:38 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 Aug 28 09:03:38 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:38 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8" returned: 0 in 0.248s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e999d77-53ef-454d-8b11-794ab4d4fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef407b2-ede0-4782-abee-92d2307b69c8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827abc23-8c31-454e-8391-3153b33f6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:03:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Volume volume-6ef407b2-ede0-4782-abee-92d2307b69c8 (6ef407b2-ede0-4782-abee-92d2307b69c8): created successfully Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827abc23-8c31-454e-8391-3153b33f6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:03:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Flow 'volume_create_manager' (e692d979-fb57-47cc-81e6-259b88f25624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:03:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8d3cc7d3-1e31-4ecd-9ea2-be4969eb42fd tempest-TestMinimumBasicScenario-30834799 None] Created volume successfully. Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:03:40 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:03:40 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-97c03d70-bcd5-4f8e-b400-643fdd1b9563 req-c1bebc59-0bdd-416e-9eed-1bb662a93a9a tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-97c03d70-bcd5-4f8e-b400-643fdd1b9563 req-c1bebc59-0bdd-416e-9eed-1bb662a93a9a tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-97c03d70-bcd5-4f8e-b400-643fdd1b9563 req-c1bebc59-0bdd-416e-9eed-1bb662a93a9a tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-97c03d70-bcd5-4f8e-b400-643fdd1b9563 req-c1bebc59-0bdd-416e-9eed-1bb662a93a9a tempest-TestMinimumBasicScenario-30834799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-6ef407b2-ede0-4782-abee-92d2307b69c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06d4b119-6763-46ba-a4d9-c6d1af9fd270', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:03:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-97c03d70-bcd5-4f8e-b400-643fdd1b9563 req-c1bebc59-0bdd-416e-9eed-1bb662a93a9a tempest-TestMinimumBasicScenario-30834799 None] attachment_update completed successfully. Aug 28 09:03:40 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.371s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:03:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:03:50 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:03:50 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:04:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-c676a6ba-334c-476d-a2a1-c8399190fb10 req-6b1bffec-0737-4d9c-8a14-599dd82d70fa tempest-TestMinimumBasicScenario-30834799 None] Terminate volume connection completed successfully. Aug 28 09:04:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-c676a6ba-334c-476d-a2a1-c8399190fb10 req-6b1bffec-0737-4d9c-8a14-599dd82d70fa tempest-TestMinimumBasicScenario-30834799 None] Deleting attachment 06d4b119-6763-46ba-a4d9-c6d1af9fd270. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "cinder-6ef407b2-ede0-4782-abee-92d2307b69c8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "cinder-6ef407b2-ede0-4782-abee-92d2307b69c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "cinder-quobyte-6ef407b2-ede0-4782-abee-92d2307b69c8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "cinder-quobyte-6ef407b2-ede0-4782-abee-92d2307b69c8" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdb6e7-e5e4-4db8-aeef-5fd28f00ee78]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:04:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:04:29 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 Aug 28 09:04:29 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:04:29 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8" returned: 0 in 0.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:04:29 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8 Aug 28 09:04:29 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:04:29 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6ef407b2-ede0-4782-abee-92d2307b69c8" returned: 0 in 0.305s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "cinder-quobyte-6ef407b2-ede0-4782-abee-92d2307b69c8" released by "delete_volume" :: held 0.730s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Created reservations ['e176cfc2-85e1-46e3-873c-1bffa25d1272', '18dfc7aa-1bd7-4a05-b1cf-987bc1792798', 'd94f2911-3730-4937-a075-a161577135fb', '400f1533-7ff1-4399-b2bd-af59ef78e4fb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:04:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:04:29 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:04:29 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:04:30 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Aug 28 09:04:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.283s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:04:30 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:04:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Deleted volume successfully. Aug 28 09:04:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fafdcbeb-cd2b-4b56-8c41-f1f632ec1053 tempest-TestMinimumBasicScenario-30834799 None] Lock "cinder-6ef407b2-ede0-4782-abee-92d2307b69c8-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:04:39 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:04:40 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:04:40 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:04:40 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.271s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:04:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Flow 'volume_create_manager' (1c8f6770-7176-49aa-bbe1-6a495da6b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58491f0-8ecc-4977-a86a-7c24a6ae292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58491f0-8ecc-4977-a86a-7c24a6ae292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-841340396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a95456-0c3f-449a-bd11-8fa275d0212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec59264021464ebfc5116664abbff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:05:05Z,use_quota=True,user_id='30ff4243b5a342b3a8f7daa48383f2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0846c46-b6c7-4087-bec5-d9c708ec1bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0846c46-b6c7-4087-bec5-d9c708ec1bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aed45a-8602-499a-9b22-d4fd78af1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aed45a-8602-499a-9b22-d4fd78af1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93a95456-0c3f-449a-bd11-8fa275d0212b', 'volume_name': 'volume-93a95456-0c3f-449a-bd11-8fa275d0212b', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b4950-45fb-4c79-8205-824de1a36e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068b4950-45fb-4c79-8205-824de1a36e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9860e-4b3f-4d02-a55e-b9df391482f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Volume 93a95456-0c3f-449a-bd11-8fa275d0212b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93a95456-0c3f-449a-bd11-8fa275d0212b', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Trying to clone 93a95456-0c3f-449a-bd11-8fa275d0212b from image f08659ba-d34f-40d3-9342-92af7297d5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:05:05 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d072b39-b850-472a-ab37-1202820b1749]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:05:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:06 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD Aug 28 09:05:06 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:06 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 is fetched for user 30ff4243b5a342b3a8f7daa48383f2de. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[93424191-a7a5-4a0c-9bc9-a079023cd414]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:06 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD Aug 28 09:05:06 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:06 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-841340396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a95456-0c3f-449a-bd11-8fa275d0212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec59264021464ebfc5116664abbff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:05:05Z,use_quota=True,user_id='30ff4243b5a342b3a8f7daa48383f2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Creating volume 93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:05:06 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:05:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:06 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1073741824 Aug 28 09:05:06 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:07 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1073741824" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:07 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b Aug 28 09:05:07 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:07 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Attempting download of f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 93a95456-0c3f-449a-bd11-8fa275d0212b. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1e3f1-98c8-4a89-b577-bfa16f29bf59]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:07 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl Aug 28 09:05:07 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:07 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl" returned: 0 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:08 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl Aug 28 09:05:08 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:08 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl" returned: 1 in 0.345s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08659ba-d34f-40d3-9342-92af7297d5d7_dgbt7xyl' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49c83e7-0f8a-4bef-af00-a1b4b0609576]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:08 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD Aug 28 09:05:08 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:08 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] f08659ba-d34f-40d3-9342-92af7297d5d7 was qcow2, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:05:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:08 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b Aug 28 09:05:08 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:10 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b" returned: 0 in 1.711s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08659ba-d34f-40d3-9342-92af7297d5d7_bnf9zwhxdevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:05:10 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Converted 112.00 MB image at 65.40 MB/s Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:10 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1G Aug 28 09:05:10 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:10 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b 1G" returned: 0 in 0.323s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Downloaded image f08659ba-d34f-40d3-9342-92af7297d5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}])) to volume 93a95456-0c3f-449a-bd11-8fa275d0212b successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Temporary image f08659ba-d34f-40d3-9342-92af7297d5d7 for user 30ff4243b5a342b3a8f7daa48383f2de is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Marking volume 93a95456-0c3f-449a-bd11-8fa275d0212b as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Copying metadata from image f08659ba-d34f-40d3-9342-92af7297d5d7 to 93a95456-0c3f-449a-bd11-8fa275d0212b. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Creating volume glance metadata for volume 93a95456-0c3f-449a-bd11-8fa275d0212b backed by image f08659ba-d34f-40d3-9342-92af7297d5d7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9860e-4b3f-4d02-a55e-b9df391482f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a95456-0c3f-449a-bd11-8fa275d0212b', 'volume_size': 1, 'image_id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08659ba-d34f-40d3-9342-92af7297d5d7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd7719daf44e4a5fb53e6b4e72c2d491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f08659ba-d34f-40d3-9342-92af7297d5d7', 'created_at': datetime.datetime(2026, 8, 28, 6, 35, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 6, 35, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08659ba-d34f-40d3-9342-92af7297d5d7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4946e388-cced-4f25-8e86-2ce4ce5ed1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:05:10 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Volume volume-93a95456-0c3f-449a-bd11-8fa275d0212b (93a95456-0c3f-449a-bd11-8fa275d0212b): created successfully Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4946e388-cced-4f25-8e86-2ce4ce5ed1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:05:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Flow 'volume_create_manager' (1c8f6770-7176-49aa-bbe1-6a495da6b57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:05:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0d9750af-7f36-413a-9176-8a743c8e019c tempest-TestShelveInstance-865934529 None] Created volume successfully. Aug 28 09:05:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-65f34ade-6d8b-4aae-a963-7b0035301a0a req-384f877f-ec8e-4c78-b2cc-d78fe3e80bee tempest-TestShelveInstance-865934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:05:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-65f34ade-6d8b-4aae-a963-7b0035301a0a req-384f877f-ec8e-4c78-b2cc-d78fe3e80bee tempest-TestShelveInstance-865934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:05:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-65f34ade-6d8b-4aae-a963-7b0035301a0a req-384f877f-ec8e-4c78-b2cc-d78fe3e80bee tempest-TestShelveInstance-865934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:05:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-65f34ade-6d8b-4aae-a963-7b0035301a0a req-384f877f-ec8e-4c78-b2cc-d78fe3e80bee tempest-TestShelveInstance-865934529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-93a95456-0c3f-449a-bd11-8fa275d0212b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38228924-f423-492c-b882-6be929d21c6d', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:05:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-65f34ade-6d8b-4aae-a963-7b0035301a0a req-384f877f-ec8e-4c78-b2cc-d78fe3e80bee tempest-TestShelveInstance-865934529 None] attachment_update completed successfully. Aug 28 09:05:24 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:INSERT=6,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:05:24 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=8 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:05:40 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:05:40 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:05:40 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:05:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:05:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-f412abd3-f6bc-4dd2-9d0c-9a41d8d31316 req-685efefc-4640-4086-b6a9-51966c979960 tempest-TestShelveInstance-865934529 None] Terminate volume connection completed successfully. Aug 28 09:05:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-f412abd3-f6bc-4dd2-9d0c-9a41d8d31316 req-685efefc-4640-4086-b6a9-51966c979960 tempest-TestShelveInstance-865934529 None] Deleting attachment 38228924-f423-492c-b882-6be929d21c6d. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:05:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-4d6da5e5-e519-4b12-ab29-f5b229b4fdb8 req-835b8e9a-351f-45d8-90b2-38157660ab5a tempest-TestShelveInstance-865934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:05:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-4d6da5e5-e519-4b12-ab29-f5b229b4fdb8 req-835b8e9a-351f-45d8-90b2-38157660ab5a tempest-TestShelveInstance-865934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:05:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-4d6da5e5-e519-4b12-ab29-f5b229b4fdb8 req-835b8e9a-351f-45d8-90b2-38157660ab5a tempest-TestShelveInstance-865934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:05:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-4d6da5e5-e519-4b12-ab29-f5b229b4fdb8 req-835b8e9a-351f-45d8-90b2-38157660ab5a tempest-TestShelveInstance-865934529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6', 'name': 'volume-93a95456-0c3f-449a-bd11-8fa275d0212b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e6b6d54-0c15-480a-8978-d1b7d3b2a3e3', 'enforce_multipath': True} {{(pid=85762) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:05:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-4d6da5e5-e519-4b12-ab29-f5b229b4fdb8 req-835b8e9a-351f-45d8-90b2-38157660ab5a tempest-TestShelveInstance-865934529 None] attachment_update completed successfully. Aug 28 09:05:57 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:05:57 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:06:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-9f008dd6-b12d-4295-a2e1-9e5b8be40c9c tempest-TestShelveInstance-865934529 None] Terminate volume connection completed successfully. Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-9f008dd6-b12d-4295-a2e1-9e5b8be40c9c tempest-TestShelveInstance-865934529 None] Deleting attachment 1e6b6d54-0c15-480a-8978-d1b7d3b2a3e3. {{(pid=85762) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Acquiring lock "cinder-93a95456-0c3f-449a-bd11-8fa275d0212b-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "cinder-93a95456-0c3f-449a-bd11-8fa275d0212b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Acquiring lock "cinder-quobyte-93a95456-0c3f-449a-bd11-8fa275d0212b" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "cinder-quobyte-93a95456-0c3f-449a-bd11-8fa275d0212b" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2197cba-e613-407f-a87c-c300789e0024]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:17 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b Aug 28 09:06:17 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:17 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:17 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b Aug 28 09:06:17 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:18 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-93a95456-0c3f-449a-bd11-8fa275d0212b" returned: 0 in 0.280s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "cinder-quobyte-93a95456-0c3f-449a-bd11-8fa275d0212b" released by "delete_volume" :: held 0.709s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.quota [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Created reservations ['f5217afe-0f10-4a8c-8c59-7228660785d0', '4cf45d8a-ae41-4c8d-90ff-b977053d3f1f', 'e0963fb3-73e0-497d-8f2d-0b5f7aefc81a', 'b1528f9d-388e-477d-9cba-b9d5cd87be42'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:18 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:18 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:18 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.278s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.manager [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Deleted volume successfully. Aug 28 09:06:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [req-c1a234e4-9b5d-45c7-beae-3fd841787633 req-1568090d-5fe8-42fc-bebe-be4d9219702d tempest-TestShelveInstance-865934529 None] Lock "cinder-93a95456-0c3f-449a-bd11-8fa275d0212b-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:28 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:06:31 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Flow 'volume_create_manager' (23ff27ee-5303-4327-9c92-cfbbd843870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d87bc3-dbc1-4309-be23-a57357fe378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d87bc3-dbc1-4309-be23-a57357fe378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed6eec-a5ae-4c50-9ad4-fd5ad37be033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5371a2325b764d679c9bba37f11a1943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:33Z,use_quota=True,user_id='801915887d454aca82b1cc9253050bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d132f5e-72c8-4b5e-99ba-ed9182cd748a),volume_type_id=1d132f5e-72c8-4b5e-99ba-ed9182cd748a)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78636346-4c86-4ac0-b237-64b85ccf9b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78636346-4c86-4ac0-b237-64b85ccf9b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be80f11-b304-4674-b698-55f5a267f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be80f11-b304-4674-b698-55f5a267f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ceed6eec-a5ae-4c50-9ad4-fd5ad37be033', 'volume_name': 'volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033', 'volume_size': 1, 'image_id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0556972b7b13fe7a9196370ab9ca61a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5371a2325b764d679c9bba37f11a1943', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '599512356d34e00a74fd9f1be11c226d8d8cccb22af694dfe5c6c59d41ba76d6e51dc6f5e96be9d8a2c5b8c1e1394b1d45d3f7cb4f9837fbe10d7ecedef17640', 'id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'created_at': datetime.datetime(2026, 8, 28, 7, 6, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 6, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ee25c4-673c-46b0-bd07-74943067067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ee25c4-673c-46b0-bd07-74943067067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237a259b-3ee6-47af-b4f0-b22b4f8bf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:33 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033', 'volume_size': 1, 'image_id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0556972b7b13fe7a9196370ab9ca61a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5371a2325b764d679c9bba37f11a1943', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '599512356d34e00a74fd9f1be11c226d8d8cccb22af694dfe5c6c59d41ba76d6e51dc6f5e96be9d8a2c5b8c1e1394b1d45d3f7cb4f9837fbe10d7ecedef17640', 'id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'created_at': datetime.datetime(2026, 8, 28, 7, 6, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 6, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Trying to clone ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 from image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:06:33 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc768705-f7b9-42b8-a757-a4af5c32e337]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:33 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:33 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:34 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:34 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:34 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:34 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 1 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Temporary image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd is fetched for user 801915887d454aca82b1cc9253050bef. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f9de2-2bc9-4b4a-a267-3d07e5ef6682]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:34 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:34 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:34 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 0 in 0.301s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:34 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:34 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:35 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 1 in 0.303s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed6eec-a5ae-4c50-9ad4-fd5ad37be033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5371a2325b764d679c9bba37f11a1943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:33Z,use_quota=True,user_id='801915887d454aca82b1cc9253050bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d132f5e-72c8-4b5e-99ba-ed9182cd748a),volume_type_id=1d132f5e-72c8-4b5e-99ba-ed9182cd748a)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Creating volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:35 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:35 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1073741824 Aug 28 09:06:35 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:35 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1073741824" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:35 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 Aug 28 09:06:35 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:35 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Attempting download of d0f6ad2d-302d-4f32-924b-430e3e0ff0fd ((None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}])) to volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2579fe-a6e4-4b99-a5fd-edfbea023d72]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:36 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07 Aug 28 09:06:36 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:36 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07" returned: 0 in 0.315s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:36 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07 Aug 28 09:06:36 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:36 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07" returned: 1 in 0.321s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_vwhlsz07' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[51001c3c-2fc3-4f45-b890-383df65485e6]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:36 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:36 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:36 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:37 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD Aug 28 09:06:37 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:37 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD" returned: 1 in 0.320s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] d0f6ad2d-302d-4f32-924b-430e3e0ff0fd was raw, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:37 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 Aug 28 09:06:37 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:37 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" returned: 0 in 0.433s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0f6ad2d-302d-4f32-924b-430e3e0ff0fd_9bwl4co3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:06:37 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:06:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:37 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1G Aug 28 09:06:37 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:37 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 1G" returned: 0 in 0.321s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Downloaded image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd ((None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}])) to volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Temporary image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd for user 801915887d454aca82b1cc9253050bef is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Marking volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Copying metadata from image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd to ceed6eec-a5ae-4c50-9ad4-fd5ad37be033. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Creating volume glance metadata for volume ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 backed by image d0f6ad2d-302d-4f32-924b-430e3e0ff0fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0556972b7b13fe7a9196370ab9ca61a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237a259b-3ee6-47af-b4f0-b22b4f8bf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033', 'volume_size': 1, 'image_id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0556972b7b13fe7a9196370ab9ca61a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5371a2325b764d679c9bba37f11a1943', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '599512356d34e00a74fd9f1be11c226d8d8cccb22af694dfe5c6c59d41ba76d6e51dc6f5e96be9d8a2c5b8c1e1394b1d45d3f7cb4f9837fbe10d7ecedef17640', 'id': 'd0f6ad2d-302d-4f32-924b-430e3e0ff0fd', 'created_at': datetime.datetime(2026, 8, 28, 7, 6, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 6, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0f6ad2d-302d-4f32-924b-430e3e0ff0fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbc11db-c521-43b2-9236-1936dd37b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:38 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Volume volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 (ceed6eec-a5ae-4c50-9ad4-fd5ad37be033): created successfully Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbc11db-c521-43b2-9236-1936dd37b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Flow 'volume_create_manager' (23ff27ee-5303-4327-9c92-cfbbd843870b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:38 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-10e62436-cf76-4990-b331-6f2081f93124 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Created volume successfully. Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Acquiring lock "cinder-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "cinder-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Acquiring lock "cinder-quobyte-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "cinder-quobyte-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b69fac-635d-4b3e-aa63-0a5f12aa86a1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:39 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 Aug 28 09:06:39 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:39 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:39 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033 Aug 28 09:06:39 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:39 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" returned: 0 in 0.276s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "cinder-quobyte-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033" released by "delete_volume" :: held 0.678s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:39 devstack cinder-volume[85762]: WARNING cinder.quota [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:06:39 devstack cinder-volume[85762]: WARNING cinder.quota [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Created reservations ['7a93c51b-9f02-44a4-86ab-46c935fe24e1', '3a8f39de-8506-46d0-adee-7849fffa0de2', '2504de36-25a3-4732-a6af-e5cf24accd96', '643367d4-5190-4838-9437-3b692afdd979'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:39 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:39 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:40 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Deleted volume successfully. Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f39994ac-0c96-4266-b9b7-09a105b397f1 tempest-VolumeAndVolumeTypeFromImageTest-468765422 None] Lock "cinder-ceed6eec-a5ae-4c50-9ad4-fd5ad37be033-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:40 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:40 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:40 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.341s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:06:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (e066f685-8518-428f-b05b-813369c509fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f41f1f4-1dd9-4537-8e7f-982c0153cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f41f1f4-1dd9-4537-8e7f-982c0153cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629137525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d99a4b-decb-4300-a185-0bcdb2a66781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:44Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b2502b-70ac-4f81-9731-3920aa15f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b2502b-70ac-4f81-9731-3920aa15f35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ae9360-0d46-4f85-b448-c90e523d3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ae9360-0d46-4f85-b448-c90e523d3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d99a4b-decb-4300-a185-0bcdb2a66781', 'volume_name': 'volume-f8d99a4b-decb-4300-a185-0bcdb2a66781', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d623ddfd-80e3-42e5-ab60-4b3310eef69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d623ddfd-80e3-42e5-ab60-4b3310eef69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87e52d-953e-4303-a345-1d19f3e30b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Volume f8d99a4b-decb-4300-a185-0bcdb2a66781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d99a4b-decb-4300-a185-0bcdb2a66781', 'volume_size': 1} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629137525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d99a4b-decb-4300-a185-0bcdb2a66781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:44Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Creating volume f8d99a4b-decb-4300-a185-0bcdb2a66781 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:44 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:44 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 1073741824 Aug 28 09:06:44 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (c2fce4bf-afd3-4b46-96a5-8a30b8d0a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a379aa-cfd7-4968-abcf-222a13f1a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a379aa-cfd7-4968-abcf-222a13f1a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920024074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2470d7be-383f-4042-a2d0-28fd28aa10b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:45Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6086e99-0427-460c-b3b6-a7f42eb8fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6086e99-0427-460c-b3b6-a7f42eb8fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a6f266-e0f2-435c-abe0-21ee5f355554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a6f266-e0f2-435c-abe0-21ee5f355554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2470d7be-383f-4042-a2d0-28fd28aa10b5', 'volume_name': 'volume-2470d7be-383f-4042-a2d0-28fd28aa10b5', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f9ab8e-9ebd-4395-9bd4-7058c77303c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f9ab8e-9ebd-4395-9bd4-7058c77303c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7919fbba-0407-49ce-b3f6-d515a2541126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:44 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Volume 2470d7be-383f-4042-a2d0-28fd28aa10b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2470d7be-383f-4042-a2d0-28fd28aa10b5', 'volume_size': 1} Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:44 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 1073741824" returned: 0 in 0.503s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:45 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 Aug 28 09:06:45 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (051634fd-c732-4357-8604-2d197210d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95651a27-3a41-43b5-b882-f61d8b3b24ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95651a27-3a41-43b5-b882-f61d8b3b24ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210456546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d1aed-2f32-45a7-803a-2f926dd11c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:45Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b14197a-c643-483d-97ec-e55242dd7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b14197a-c643-483d-97ec-e55242dd7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71ad37a-c5d7-497e-9392-01dc21eec95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71ad37a-c5d7-497e-9392-01dc21eec95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531d1aed-2f32-45a7-803a-2f926dd11c4d', 'volume_name': 'volume-531d1aed-2f32-45a7-803a-2f926dd11c4d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266a5626-1bd0-431c-97e9-03b3d707822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266a5626-1bd0-431c-97e9-03b3d707822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8026e97d-9a87-41a4-87f2-80207837f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Volume 531d1aed-2f32-45a7-803a-2f926dd11c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531d1aed-2f32-45a7-803a-2f926dd11c4d', 'volume_size': 1} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:45 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781" returned: 0 in 0.318s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920024074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2470d7be-383f-4042-a2d0-28fd28aa10b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:45Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Creating volume 2470d7be-383f-4042-a2d0-28fd28aa10b5 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87e52d-953e-4303-a345-1d19f3e30b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d99a4b-decb-4300-a185-0bcdb2a66781', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 1073741824 Aug 28 09:06:45 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba897a-0d3c-4a38-bc52-028b687c6bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Volume volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 (f8d99a4b-decb-4300-a185-0bcdb2a66781): created successfully Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba897a-0d3c-4a38-bc52-028b687c6bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (e066f685-8518-428f-b05b-813369c509fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6b4d15fa-b7bb-4560-a4f0-7a9b263492d8 tempest-CreateVolumesFromImageTest-899128595 None] Created volume successfully. Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (81501202-a865-4ae6-bafd-19b8d77d1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74badca6-f24e-44ad-b00b-270210897830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74badca6-f24e-44ad-b00b-270210897830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854222518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a67b4f-481e-443e-b97c-395f70869b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:46Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42900743-763b-406c-976c-40c567529042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42900743-763b-406c-976c-40c567529042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc8add-f6f5-48b1-bbf1-1b649480f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc8add-f6f5-48b1-bbf1-1b649480f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a67b4f-481e-443e-b97c-395f70869b6f', 'volume_name': 'volume-a0a67b4f-481e-443e-b97c-395f70869b6f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d0d033-c09f-4537-a95f-babdace77b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d0d033-c09f-4537-a95f-babdace77b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6966db17-09bd-4141-9ad5-ecd6a2f021bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Volume a0a67b4f-481e-443e-b97c-395f70869b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a67b4f-481e-443e-b97c-395f70869b6f', 'volume_size': 1} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:45 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 1073741824" returned: 0 in 0.541s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:45 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 Aug 28 09:06:45 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (224bc34e-f611-4940-b0c3-397e9b9dc49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2d31de-ed61-468e-a9fc-b0229cb04a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2d31de-ed61-468e-a9fc-b0229cb04a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502569369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c342f3-a33a-4990-b650-bf76ac6ec20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:46Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940ed2f8-5c15-4515-b711-8dc1f065bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940ed2f8-5c15-4515-b711-8dc1f065bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47ff0bd-0d73-45ea-91dd-f315cb948239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47ff0bd-0d73-45ea-91dd-f315cb948239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c342f3-a33a-4990-b650-bf76ac6ec20f', 'volume_name': 'volume-03c342f3-a33a-4990-b650-bf76ac6ec20f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a060e5e-064c-4686-a824-f9bc4babe897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a060e5e-064c-4686-a824-f9bc4babe897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbe6bbe-2699-4c8d-b624-440358f387f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Volume 03c342f3-a33a-4990-b650-bf76ac6ec20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c342f3-a33a-4990-b650-bf76ac6ec20f', 'volume_size': 1} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:46 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5" returned: 0 in 0.284s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210456546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d1aed-2f32-45a7-803a-2f926dd11c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:45Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Creating volume 531d1aed-2f32-45a7-803a-2f926dd11c4d {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:46 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7919fbba-0407-49ce-b3f6-d515a2541126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2470d7be-383f-4042-a2d0-28fd28aa10b5', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b47884-6695-4ef4-900e-e6442980ca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:46 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d 1073741824 Aug 28 09:06:46 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Volume volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 (2470d7be-383f-4042-a2d0-28fd28aa10b5): created successfully Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b47884-6695-4ef4-900e-e6442980ca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (c2fce4bf-afd3-4b46-96a5-8a30b8d0a0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-65ceca5f-4fd4-49c0-8270-d813794bab4c tempest-CreateVolumesFromImageTest-899128595 None] Created volume successfully. Aug 28 09:06:46 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d 1073741824" returned: 0 in 0.443s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:46 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d Aug 28 09:06:46 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:46 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854222518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a67b4f-481e-443e-b97c-395f70869b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:46Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Creating volume a0a67b4f-481e-443e-b97c-395f70869b6f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:46 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8026e97d-9a87-41a4-87f2-80207837f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531d1aed-2f32-45a7-803a-2f926dd11c4d', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35222818-413b-4f3a-b2af-e38838c24b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:47 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f 1073741824 Aug 28 09:06:47 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Volume volume-531d1aed-2f32-45a7-803a-2f926dd11c4d (531d1aed-2f32-45a7-803a-2f926dd11c4d): created successfully Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35222818-413b-4f3a-b2af-e38838c24b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (051634fd-c732-4357-8604-2d197210d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-069af373-b00f-49e2-9470-339a201a7de7 tempest-CreateVolumesFromImageTest-899128595 None] Created volume successfully. Aug 28 09:06:47 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f 1073741824" returned: 0 in 0.433s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:47 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f Aug 28 09:06:47 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:47 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502569369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c342f3-a33a-4990-b650-bf76ac6ec20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b71eb4df9924169b755a842d4538029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:06:46Z,use_quota=True,user_id='ea84de5029ab4f78a682046145fe1629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Creating volume 03c342f3-a33a-4990-b650-bf76ac6ec20f {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:06:47 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:47 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f 1073741824 Aug 28 09:06:47 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6966db17-09bd-4141-9ad5-ecd6a2f021bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a67b4f-481e-443e-b97c-395f70869b6f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da58d090-9dc9-4897-92aa-8e9b74fe51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:47 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Volume volume-a0a67b4f-481e-443e-b97c-395f70869b6f (a0a67b4f-481e-443e-b97c-395f70869b6f): created successfully Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da58d090-9dc9-4897-92aa-8e9b74fe51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:47 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (81501202-a865-4ae6-bafd-19b8d77d1efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:47 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f48c00c0-9a00-4a0c-941a-472edfafd023 tempest-CreateVolumesFromImageTest-899128595 None] Created volume successfully. Aug 28 09:06:48 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f 1073741824" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:48 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f Aug 28 09:06:48 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:48 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f" returned: 0 in 0.241s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbe6bbe-2699-4c8d-b624-440358f387f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c342f3-a33a-4990-b650-bf76ac6ec20f', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a76467e-ccc7-4b95-b399-7f56b87e5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:06:48 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Volume volume-03c342f3-a33a-4990-b650-bf76ac6ec20f (03c342f3-a33a-4990-b650-bf76ac6ec20f): created successfully Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a76467e-ccc7-4b95-b399-7f56b87e5315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:06:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Flow 'volume_create_manager' (224bc34e-f611-4940-b0c3-397e9b9dc49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:06:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a9de2cb1-eb4a-4ffa-a0e8-36518092a2be tempest-CreateVolumesFromImageTest-899128595 None] Created volume successfully. Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-03c342f3-a33a-4990-b650-bf76ac6ec20f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-03c342f3-a33a-4990-b650-bf76ac6ec20f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-quobyte-03c342f3-a33a-4990-b650-bf76ac6ec20f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-03c342f3-a33a-4990-b650-bf76ac6ec20f" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd8f7f-a745-4e1c-b069-28b09f45d5f0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:49 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f Aug 28 09:06:49 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:49 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:49 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f Aug 28 09:06:49 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:50 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-03c342f3-a33a-4990-b650-bf76ac6ec20f" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-03c342f3-a33a-4990-b650-bf76ac6ec20f" released by "delete_volume" :: held 0.662s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Created reservations ['8d6749e7-2f44-4e63-995f-bdbcc97463fb', 'd8763d33-0d66-440f-a692-afedee7b62ee', '24c2355c-7eb0-4e93-ab0c-3048a236a486', '7ccd9876-d4bc-4056-875c-06b75b0f2943'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:50 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:50 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:50 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.235s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Deleted volume successfully. Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-02b6fd9d-d36e-4b88-94d6-be47ebd4c8c7 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-03c342f3-a33a-4990-b650-bf76ac6ec20f-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-a0a67b4f-481e-443e-b97c-395f70869b6f-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-a0a67b4f-481e-443e-b97c-395f70869b6f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-quobyte-a0a67b4f-481e-443e-b97c-395f70869b6f" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-a0a67b4f-481e-443e-b97c-395f70869b6f" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab30022-922b-4d0d-b8f1-156936854403]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:50 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f Aug 28 09:06:50 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:50 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:51 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f Aug 28 09:06:51 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:51 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a0a67b4f-481e-443e-b97c-395f70869b6f" returned: 0 in 0.254s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-a0a67b4f-481e-443e-b97c-395f70869b6f" released by "delete_volume" :: held 0.642s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Created reservations ['5bd6f600-1ac5-44f0-8932-3edeb98fa2b3', 'e0edd0a8-8f49-4784-9e9a-16ca02ced995', 'ed78a17d-b655-46ec-972a-1bf329f04625', 'e7dd7bff-0c87-40f3-a324-ea72d07629d5'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:51 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:51 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:51 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Deleted volume successfully. Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-783b2bf7-d764-47d0-9879-cacc56d55585 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-a0a67b4f-481e-443e-b97c-395f70869b6f-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-531d1aed-2f32-45a7-803a-2f926dd11c4d-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-531d1aed-2f32-45a7-803a-2f926dd11c4d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-quobyte-531d1aed-2f32-45a7-803a-2f926dd11c4d" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-531d1aed-2f32-45a7-803a-2f926dd11c4d" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1f6df-10fd-456a-b06e-52e235aec44d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:51 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d Aug 28 09:06:51 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:52 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d" returned: 0 in 0.382s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:52 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d Aug 28 09:06:52 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:52 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-531d1aed-2f32-45a7-803a-2f926dd11c4d" returned: 0 in 0.265s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-531d1aed-2f32-45a7-803a-2f926dd11c4d" released by "delete_volume" :: held 0.692s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Created reservations ['0c8fe3f5-4700-41e5-8115-ecc7b7941117', '9adee796-c268-41ab-9127-acfedcb39f4e', 'fb99bd1d-1b85-43cc-b0ae-e212915e89e5', '9cb8d204-ba8f-4c3a-b578-a559835bb108'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:52 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:52 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:52 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-2470d7be-383f-4042-a2d0-28fd28aa10b5-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.274s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:52 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Deleted volume successfully. Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-2470d7be-383f-4042-a2d0-28fd28aa10b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7e0f55de-db1c-4e59-8848-12ce8fc8b752 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-531d1aed-2f32-45a7-803a-2f926dd11c4d-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-quobyte-2470d7be-383f-4042-a2d0-28fd28aa10b5" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-2470d7be-383f-4042-a2d0-28fd28aa10b5" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcc4d8-7ee6-4eb7-bcea-3084608a7d28]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:53 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 Aug 28 09:06:53 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:53 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5" returned: 0 in 0.367s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:53 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5 Aug 28 09:06:53 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:53 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-2470d7be-383f-4042-a2d0-28fd28aa10b5" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-2470d7be-383f-4042-a2d0-28fd28aa10b5" released by "delete_volume" :: held 0.657s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Created reservations ['0e528eff-677c-46ea-92e3-d8112d2a2e37', '3c46d68c-d7b7-4492-a5ca-e036197fe840', '3319e34f-0a80-4c2d-9bb7-4cb24241e19e', '92124ed5-b67e-4979-82e5-9b0c17ed4a82'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:53 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:53 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:54 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Deleted volume successfully. Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29b4b076-90e8-46f6-b3d5-c1fc216c9639 tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-2470d7be-383f-4042-a2d0-28fd28aa10b5-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-f8d99a4b-decb-4300-a185-0bcdb2a66781-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-f8d99a4b-decb-4300-a185-0bcdb2a66781-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "cinder-quobyte-f8d99a4b-decb-4300-a185-0bcdb2a66781" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-f8d99a4b-decb-4300-a185-0bcdb2a66781" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fde22b-c872-4d52-80b2-f923562c9f59]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:54 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 Aug 28 09:06:54 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:54 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781" returned: 0 in 0.398s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:54 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781 Aug 28 09:06:54 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:54 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f8d99a4b-decb-4300-a185-0bcdb2a66781" returned: 0 in 0.241s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-quobyte-f8d99a4b-decb-4300-a185-0bcdb2a66781" released by "delete_volume" :: held 0.679s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Created reservations ['5d396dce-f90b-405f-9570-eae39da5a341', '2d7f4daf-7b92-4d69-a239-70e8613e7ede', 'b1afcaf3-0d38-4c52-9ae1-c32709927f6e', '0944f256-d19c-4908-a1f6-a62c0ce2149a'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:06:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:06:54 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:06:54 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:06:55 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Aug 28 09:06:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.231s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:06:55 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:06:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Deleted volume successfully. Aug 28 09:06:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fa4c0a63-424b-4ced-a7e5-07b78bdfbe6c tempest-CreateVolumesFromImageTest-899128595 None] Lock "cinder-f8d99a4b-decb-4300-a185-0bcdb2a66781-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:04 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=46,cinder:INSERT=16,cinder:UPDATE=62,cinder:DELETE=5 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:07:05 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=73,cinder:SELECT=50,cinder:INSERT=24,cinder:DELETE=7 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (45466c84-eeff-4807-8af2-26e242399746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac111d51-37c9-4114-a6a9-7c0b421ca39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac111d51-37c9-4114-a6a9-7c0b421ca39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896637919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc9f645-e7bf-4233-8aea-f2eb7ca97129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39343e47-0bad-4533-a64b-a6c74b00e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39343e47-0bad-4533-a64b-a6c74b00e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d783c6-30a2-49fb-acad-0783278bcf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d783c6-30a2-49fb-acad-0783278bcf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc9f645-e7bf-4233-8aea-f2eb7ca97129', 'volume_name': 'volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54df1b78-aefe-4bf8-a6b9-13ce2eb2d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54df1b78-aefe-4bf8-a6b9-13ce2eb2d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604e6388-6a2c-4750-a99d-ed158444c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Volume 3dc9f645-e7bf-4233-8aea-f2eb7ca97129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129', 'volume_size': 1} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-896637919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc9f645-e7bf-4233-8aea-f2eb7ca97129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Creating volume 3dc9f645-e7bf-4233-8aea-f2eb7ca97129 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:16 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:16 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 1073741824 Aug 28 09:07:16 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (aeba3a42-f83c-4254-b148-2166048befa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c0793f-27a2-4e86-a038-15b3ef7f79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c0793f-27a2-4e86-a038-15b3ef7f79b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-88944385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1c67b4-0612-4d36-8741-bc7de63e90bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1aad3-40e3-4d6e-a1e3-86ad3d1fea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1aad3-40e3-4d6e-a1e3-86ad3d1fea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828bd3f9-041f-49ad-8bdc-83622ca13b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828bd3f9-041f-49ad-8bdc-83622ca13b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1c67b4-0612-4d36-8741-bc7de63e90bb', 'volume_name': 'volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a5301-07ba-4250-9701-8d0c9e4b6800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a5301-07ba-4250-9701-8d0c9e4b6800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79fd9c-a7fa-4a40-9ef4-5f3ade1c20e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume ff1c67b4-0612-4d36-8741-bc7de63e90bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb', 'volume_size': 1} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (5b560f2c-3690-46f6-92d4-c9397350d292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ae868-a611-49bf-8bec-6908465a301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ae868-a611-49bf-8bec-6908465a301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503215462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d683a3af-e228-4ec1-bbc7-a24abacbe09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53203cdd-da0d-4c7a-aca1-ebf85a2c6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53203cdd-da0d-4c7a-aca1-ebf85a2c6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139f45f4-9276-4c94-8e13-72d303351a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139f45f4-9276-4c94-8e13-72d303351a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd683a3af-e228-4ec1-bbc7-a24abacbe09c', 'volume_name': 'volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2d2fd1-fc70-4b1a-8fd2-ae6b2d060b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2d2fd1-fc70-4b1a-8fd2-ae6b2d060b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a8f897-9606-4b62-a0f5-26a6f9f97efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Volume d683a3af-e228-4ec1-bbc7-a24abacbe09c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c', 'volume_size': 1} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Flow 'volume_create_manager' (2e46ace5-d432-4522-a755-71b2ff8f4f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca644b3d-19c3-4a24-a99b-431d4825af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca644b3d-19c3-4a24-a99b-431d4825af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1624179969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d389df-f550-43ca-90ed-f24366367291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64171a8f3aba49b086405a26da84e698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:17Z,use_quota=True,user_id='a2707d6c929f41688a1f5cb58d72e6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9520e6-5429-4a13-ab7f-b1ace83890ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9520e6-5429-4a13-ab7f-b1ace83890ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49e5051-c21d-4017-8b31-0aa2e0aacb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49e5051-c21d-4017-8b31-0aa2e0aacb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d389df-f550-43ca-90ed-f24366367291', 'volume_name': 'volume-b2d389df-f550-43ca-90ed-f24366367291', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ef44bf-3877-49c5-895a-856569129cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ef44bf-3877-49c5-895a-856569129cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f554b5-c375-4c2c-bc84-ea2d4a27052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:16 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Volume b2d389df-f550-43ca-90ed-f24366367291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d389df-f550-43ca-90ed-f24366367291', 'volume_size': 1} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 1073741824" returned: 0 in 0.765s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:17 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 Aug 28 09:07:17 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (a8dd3e95-221d-4de9-a480-40b8e2c6f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df723ca-c5d2-4255-b3e6-b8653fe24668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df723ca-c5d2-4255-b3e6-b8653fe24668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-875211294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a852927d-36cb-4179-92a3-10b5875baa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:17Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166c1bae-c22d-40bc-b486-bb014f01f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166c1bae-c22d-40bc-b486-bb014f01f52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b7de5a-b076-43ee-9d04-9c5d8e8a58a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b7de5a-b076-43ee-9d04-9c5d8e8a58a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a852927d-36cb-4179-92a3-10b5875baa3c', 'volume_name': 'volume-a852927d-36cb-4179-92a3-10b5875baa3c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95812077-726a-46f8-8420-5de31ec536a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95812077-726a-46f8-8420-5de31ec536a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acbe1d4-bcc4-4277-85a6-9ecd79b53775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Volume a852927d-36cb-4179-92a3-10b5875baa3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a852927d-36cb-4179-92a3-10b5875baa3c', 'volume_size': 1} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" returned: 0 in 0.383s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-88944385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1c67b4-0612-4d36-8741-bc7de63e90bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:17 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604e6388-6a2c-4750-a99d-ed158444c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d619d5-9f34-4382-91d7-8b555a4b0bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb 1073741824 Aug 28 09:07:17 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Volume volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 (3dc9f645-e7bf-4233-8aea-f2eb7ca97129): created successfully Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d619d5-9f34-4382-91d7-8b555a4b0bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (45466c84-eeff-4807-8af2-26e242399746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b3707847-1db9-4dd9-befe-9ab0cbcebb48 tempest-CreateVolumesFromImageTest-1494079356 None] Created volume successfully. Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (1a2a9267-3677-41a5-a91b-6a2a4284993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29373b18-5044-4d95-85fe-5f04afc5ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29373b18-5044-4d95-85fe-5f04afc5ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401986910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d74050-098e-48ac-bf0a-e83b0b313550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:18Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87012416-fc2b-44c2-87d5-15fabb8aac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87012416-fc2b-44c2-87d5-15fabb8aac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369baad9-02b8-422f-b561-adc052c092f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369baad9-02b8-422f-b561-adc052c092f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d74050-098e-48ac-bf0a-e83b0b313550', 'volume_name': 'volume-54d74050-098e-48ac-bf0a-e83b0b313550', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc92607e-0912-4598-a1df-38371de83dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc92607e-0912-4598-a1df-38371de83dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e2a460-4cdf-4c61-9480-677976265623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:17 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Volume 54d74050-098e-48ac-bf0a-e83b0b313550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d74050-098e-48ac-bf0a-e83b0b313550', 'volume_size': 1} Aug 28 09:07:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:18 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb 1073741824" returned: 0 in 0.702s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (3a5325f6-326e-49dc-a0eb-a8132e69fb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:18 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb Aug 28 09:07:18 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902a0ee-fba4-4e5d-a3e9-5d1a13adfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902a0ee-fba4-4e5d-a3e9-5d1a13adfd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-459051190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c4c27a-751c-4e69-ae2f-303b4ee9c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:18Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e94e9d0-ab21-46a8-a4fa-ccb5c5874af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e94e9d0-ab21-46a8-a4fa-ccb5c5874af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605c90a8-0aad-4d00-8061-6d6d2b43af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605c90a8-0aad-4d00-8061-6d6d2b43af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c4c27a-751c-4e69-ae2f-303b4ee9c96e', 'volume_name': 'volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab977a3a-6898-43fc-9341-eeae72917048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab977a3a-6898-43fc-9341-eeae72917048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b798613-dc52-4c4d-af9c-68a71543df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Volume 49c4c27a-751c-4e69-ae2f-303b4ee9c96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e', 'volume_size': 1} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:18 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503215462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d683a3af-e228-4ec1-bbc7-a24abacbe09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:16Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Creating volume d683a3af-e228-4ec1-bbc7-a24abacbe09c {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:18 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af79fd9c-a7fa-4a40-9ef4-5f3ade1c20e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c 1073741824 Aug 28 09:07:18 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb28053-5a0b-47e4-a87c-744114536ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:18 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb (ff1c67b4-0612-4d36-8741-bc7de63e90bb): created successfully Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb28053-5a0b-47e4-a87c-744114536ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (aeba3a42-f83c-4254-b148-2166048befa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-15ba7289-f69c-4663-9cef-254abfcbaec8 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:19 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c 1073741824" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:19 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c Aug 28 09:07:19 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:19 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c" returned: 0 in 0.293s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.431s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1624179969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d389df-f550-43ca-90ed-f24366367291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64171a8f3aba49b086405a26da84e698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:17Z,use_quota=True,user_id='a2707d6c929f41688a1f5cb58d72e6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Creating volume b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:19 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a8f897-9606-4b62-a0f5-26a6f9f97efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704bf62-fe55-4e42-ac36-8d4c3b6ea877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:19 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 1073741824 Aug 28 09:07:19 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Volume volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c (d683a3af-e228-4ec1-bbc7-a24abacbe09c): created successfully Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704bf62-fe55-4e42-ac36-8d4c3b6ea877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (5b560f2c-3690-46f6-92d4-c9397350d292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e2f3dcfa-2543-433f-96cc-30eb2cb95e7d tempest-CreateVolumesFromImageTest-1494079356 None] Created volume successfully. Aug 28 09:07:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:20 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 1073741824" returned: 0 in 0.631s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:20 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:20 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:20 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.283s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.967s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-875211294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a852927d-36cb-4179-92a3-10b5875baa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:17Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Creating volume a852927d-36cb-4179-92a3-10b5875baa3c {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:20 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f554b5-c375-4c2c-bc84-ea2d4a27052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d389df-f550-43ca-90ed-f24366367291', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418d233a-9aa1-4585-bd5b-79dd0f56662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:20 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c 1073741824 Aug 28 09:07:20 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Volume volume-b2d389df-f550-43ca-90ed-f24366367291 (b2d389df-f550-43ca-90ed-f24366367291): created successfully Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418d233a-9aa1-4585-bd5b-79dd0f56662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Flow 'volume_create_manager' (2e46ace5-d432-4522-a755-71b2ff8f4f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e7830dd8-0a85-4635-bdbf-8cc60bafcc44 tempest-VolumeDependencyTests-427957474 None] Created volume successfully. Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Flow 'volume_create_manager' (91f32d09-d2bf-4639-8076-0119ccd0df00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e11c8a5-a750-4cc6-abab-2865b81dca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e11c8a5-a750-4cc6-abab-2865b81dca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5faad9-7c4c-4349-8b65-a1d61eebf000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecb627593c3452a8af0476060fc10c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:21Z,use_quota=True,user_id='a6fcc2602505493eb3e837e61ebe5017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66825a97-6d12-4b51-83f5-8069e38b712b),volume_type_id=66825a97-6d12-4b51-83f5-8069e38b712b)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f77bd6d-a91c-4797-9205-319486690500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f77bd6d-a91c-4797-9205-319486690500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b4387e-3041-4d14-8624-1c72f8e9b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:20 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:07:21 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c 1073741824" returned: 0 in 0.628s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:21 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c Aug 28 09:07:21 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b4387e-3041-4d14-8624-1c72f8e9b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b5faad9-7c4c-4349-8b65-a1d61eebf000', 'volume_name': 'volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000', 'volume_size': 1, 'image_id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09ae70bda677b565d14df48c3142a8bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ecb627593c3452a8af0476060fc10c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04a0d53f7e45ff3f7dc4afabb3112efe06c2f92b9fc14a996b4dfdeeb93100d6cb4cc8d2ca97c05dac3853d3a8d0b6e8f67ff21c849e6a5923c9463eddbc1abd', 'id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6aa424-5244-452e-97ff-a2607aec51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6aa424-5244-452e-97ff-a2607aec51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f5a629-599d-4237-b7ad-44526500cc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000', 'volume_size': 1, 'image_id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09ae70bda677b565d14df48c3142a8bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ecb627593c3452a8af0476060fc10c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04a0d53f7e45ff3f7dc4afabb3112efe06c2f92b9fc14a996b4dfdeeb93100d6cb4cc8d2ca97c05dac3853d3a8d0b6e8f67ff21c849e6a5923c9463eddbc1abd', 'id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Trying to clone 4b5faad9-7c4c-4349-8b65-a1d61eebf000 from image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d at location (None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:07:21 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb16a9-bb36-4013-86e3-5d0b40944d61]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:21 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401986910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d74050-098e-48ac-bf0a-e83b0b313550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:18Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Creating volume 54d74050-098e-48ac-bf0a-e83b0b313550 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:21 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:21 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:21 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 1073741824 Aug 28 09:07:21 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acbe1d4-bcc4-4277-85a6-9ecd79b53775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a852927d-36cb-4179-92a3-10b5875baa3c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:21 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a68c8f7-9b2d-44fc-84c2-a3f8a9afed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:21 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Volume volume-a852927d-36cb-4179-92a3-10b5875baa3c (a852927d-36cb-4179-92a3-10b5875baa3c): created successfully Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a68c8f7-9b2d-44fc-84c2-a3f8a9afed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (a8dd3e95-221d-4de9-a480-40b8e2c6f78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e82d6599-45d3-4125-b600-669fbb36f35c tempest-CreateVolumesFromImageTest-1494079356 None] Created volume successfully. Aug 28 09:07:21 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:21 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:21 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:21 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 1073741824" returned: 0 in 0.492s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:21 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 Aug 28 09:07:21 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:22 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Temporary image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d is fetched for user a6fcc2602505493eb3e837e61ebe5017. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b55a1e-e0d4-4254-8607-a74bb5798461]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:22 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550" returned: 0 in 0.262s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.900s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-459051190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c4c27a-751c-4e69-ae2f-303b4ee9c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='095024dab27d472896fa0c458dd4d1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:18Z,use_quota=True,user_id='70c010660a564d44a4a8e5516236957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Creating volume 49c4c27a-751c-4e69-ae2f-303b4ee9c96e {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:22 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:22 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e 1073741824 Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e2a460-4cdf-4c61-9480-677976265623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d74050-098e-48ac-bf0a-e83b0b313550', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:22 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f958337-3ac8-41ef-badf-c9b0d4e8be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:22 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Volume volume-54d74050-098e-48ac-bf0a-e83b0b313550 (54d74050-098e-48ac-bf0a-e83b0b313550): created successfully Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f958337-3ac8-41ef-badf-c9b0d4e8be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (1a2a9267-3677-41a5-a91b-6a2a4284993b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:22 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:22 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-cc3eb749-fedb-4ba6-af18-b73337b4550f tempest-CreateVolumesFromImageTest-1494079356 None] Created volume successfully. Aug 28 09:07:22 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:22 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:22 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:22 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e 1073741824" returned: 0 in 0.498s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:22 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e Aug 28 09:07:22 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:22 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:07:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:23 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" returned: 0 in 0.253s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.271s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b798613-dc52-4c4d-af9c-68a71543df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53a37e2-af62-4c5a-9536-ffe0aadb5b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating offline snapshot 0b7ad3f7-a349-4680-9ce0-680df07442f4 of volume ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:07:23 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Volume volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e (49c4c27a-751c-4e69-ae2f-303b4ee9c96e): created successfully Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53a37e2-af62-4c5a-9536-ffe0aadb5b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Flow 'volume_create_manager' (3a5325f6-326e-49dc-a0eb-a8132e69fb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb9f02-2411-4834-9137-8abab6d6fb99]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-763f9b35-8f17-4044-8b2f-b5d00f9c0a53 tempest-CreateVolumesFromImageTest-1494079356 None] Created volume successfully. Aug 28 09:07:23 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb Aug 28 09:07:23 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:23 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb" returned: 0 in 0.358s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:23 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 1G Aug 28 09:07:23 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:23 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 1G" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:23 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 Aug 28 09:07:23 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-49c4c27a-751c-4e69-ae2f-303b4ee9c96e-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-49c4c27a-751c-4e69-ae2f-303b4ee9c96e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-quobyte-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be3ebc-84e7-4ccc-9399-8dc463cc9f9a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e Aug 28 09:07:24 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:24 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4" returned: 0 in 0.341s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 is being set with open permissions: ugo+rw Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 Aug 28 09:07:24 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:24 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" returned: 0 in 0.371s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e Aug 28 09:07:24 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:24 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4" returned: 0 in 0.298s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info Aug 28 09:07:24 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:24 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-49c4c27a-751c-4e69-ae2f-303b4ee9c96e" released by "delete_volume" :: held 0.696s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Created reservations ['892a266f-6072-4e48-be53-255e7f09e319', '2b32aed1-44e2-4c1b-a9d6-8d4d324d0599', '90b134aa-74ed-4bc2-aa86-7da6509774ce', '70a5c625-b599-40c3-ae93-5df9b56372c4'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:24 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info" returned: 0 in 0.301s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info is being set with open permissions: ugo+rw Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:24 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info Aug 28 09:07:24 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:24 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:24 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-54d74050-098e-48ac-bf0a-e83b0b313550-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-54d74050-098e-48ac-bf0a-e83b0b313550-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:25 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.info" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.929s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:25 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.324s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Creating offline snapshot c477a5b9-6309-4c1c-89c0-cee498d54a34 of volume b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:07:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Deleted volume successfully. Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497c95f-3ccd-4dce-b8fe-f0b845054f7f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3ccade37-5870-4a48-a51e-d885a3a81f5a tempest-CreateVolumesFromSnapshotTest-187804604 None] Create snapshot completed successfully Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-153a8a09-f6fb-42b6-86ae-7a79f228f7e0 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-49c4c27a-751c-4e69-ae2f-303b4ee9c96e-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-quobyte-54d74050-098e-48ac-bf0a-e83b0b313550" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-54d74050-098e-48ac-bf0a-e83b0b313550" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f7390-1782-4d4c-aa80-2559d2bfe5b4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:25 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:25 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:25 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 Aug 28 09:07:25 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:25 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.375s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:25 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 1G Aug 28 09:07:25 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:25 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550" returned: 0 in 0.401s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:25 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550 Aug 28 09:07:25 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:26 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-54d74050-098e-48ac-bf0a-e83b0b313550" returned: 0 in 0.318s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-54d74050-098e-48ac-bf0a-e83b0b313550" released by "delete_volume" :: held 0.759s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Created reservations ['f65378d9-b709-4511-8d3d-9490638f2a0f', '0071cf64-a25a-443e-a24e-0658ca35978c', '4306fa43-1a4f-4f46-a4eb-ced256adb241', 'bbee6588-fcfe-48e4-8e50-589e4c1893bb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:26 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 1G" returned: 0 in 0.511s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d389df-f550-43ca-90ed-f24366367291 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:26 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d389df-f550-43ca-90ed-f24366367291 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:26 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:26 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:26 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-a852927d-36cb-4179-92a3-10b5875baa3c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-a852927d-36cb-4179-92a3-10b5875baa3c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-quobyte-a852927d-36cb-4179-92a3-10b5875baa3c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-a852927d-36cb-4179-92a3-10b5875baa3c" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be9273-bfd0-4c1d-ba87-55867bed0a96]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:26 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d389df-f550-43ca-90ed-f24366367291 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.478s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 is being set with open permissions: ugo+rw Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:26 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:26 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:26 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Deleted volume successfully. Aug 28 09:07:26 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c Aug 28 09:07:26 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (9823092e-287d-4456-99d1-51c29eb9e5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c3949-3fc3-4f5f-9cef-ea31c1e37b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1c983ccf-e153-4c7d-a047-11e6909bebc6 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-54d74050-098e-48ac-bf0a-e83b0b313550-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c3949-3fc3-4f5f-9cef-ea31c1e37b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261140290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68666666-518e-41d9-951f-ac05df50c0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:27Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad4b0d0-c757-4432-aed1-0daa9247b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad4b0d0-c757-4432-aed1-0daa9247b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7d4843-b24b-45b5-8f0a-a8a5d4433a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7d4843-b24b-45b5-8f0a-a8a5d4433a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68666666-518e-41d9-951f-ac05df50c0ae', 'volume_name': 'volume-68666666-518e-41d9-951f-ac05df50c0ae', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ed2509-a22f-456e-923b-4220c9b925d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ed2509-a22f-456e-923b-4220c9b925d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aaed75-e4f3-4de5-b3ee-ba32242b0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:26 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume 68666666-518e-41d9-951f-ac05df50c0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68666666-518e-41d9-951f-ac05df50c0ae', 'volume_size': 1} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:26 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.308s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:26 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c" returned: 0 in 0.475s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:27 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info Aug 28 09:07:27 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:27 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c Aug 28 09:07:27 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (a266229c-cd4a-44e0-a5f8-cfbfe96a65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58ee2dc-b9ad-45a7-a2aa-c52cb6680e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58ee2dc-b9ad-45a7-a2aa-c52cb6680e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200680249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e7233-dc9c-401f-9a48-dfc78f3172a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:27Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb2b73d-a076-4da7-a020-412874719225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb2b73d-a076-4da7-a020-412874719225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88487cc1-640e-4888-9fed-96c57edae074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88487cc1-640e-4888-9fed-96c57edae074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37e7233-dc9c-401f-9a48-dfc78f3172a8', 'volume_name': 'volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aad92d-67ed-4ae4-b2ea-1c598975dca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aad92d-67ed-4ae4-b2ea-1c598975dca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6139219-4c40-43bc-8659-3fffcddfc5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume e37e7233-dc9c-401f-9a48-dfc78f3172a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8', 'volume_size': 1} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info" returned: 0 in 0.336s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:27 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info is being set with open permissions: ugo+rw Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:27 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info Aug 28 09:07:27 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:27 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a852927d-36cb-4179-92a3-10b5875baa3c" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-a852927d-36cb-4179-92a3-10b5875baa3c" released by "delete_volume" :: held 0.880s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Created reservations ['8ecd7eb3-ce1f-4665-9041-55e35e62f75f', '2035816a-2804-4049-a3a8-79c9a997c408', '303a36fe-4016-473c-bf03-31e253cb268c', 'd5e0c025-8987-490a-b407-12ff490ef027'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:27 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:27 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:27 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (56c5475e-18cd-45d9-ae18-79dfd79c7da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd7b078-8fe9-4128-aafa-d2255fff6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.info" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5faad9-7c4c-4349-8b65-a1d61eebf000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ecb627593c3452a8af0476060fc10c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:21Z,use_quota=True,user_id='a6fcc2602505493eb3e837e61ebe5017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66825a97-6d12-4b51-83f5-8069e38b712b),volume_type_id=66825a97-6d12-4b51-83f5-8069e38b712b)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Creating volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:27 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-d683a3af-e228-4ec1-bbc7-a24abacbe09c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:27 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1073741824 Aug 28 09:07:27 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd7b078-8fe9-4128-aafa-d2255fff6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220322714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8685e4b-6db9-4eb3-9962-369cd76711c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d9e72-5716-48d5-9fba-14212694034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8d9e72-5716-48d5-9fba-14212694034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e043fb-887d-48f5-a715-fe8fba84e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e043fb-887d-48f5-a715-fe8fba84e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8685e4b-6db9-4eb3-9962-369cd76711c8', 'volume_name': 'volume-a8685e4b-6db9-4eb3-9962-369cd76711c8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb34ca7-f105-46e8-8042-09f9b8b8d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb34ca7-f105-46e8-8042-09f9b8b8d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03bca7c-5489-40f6-8321-78db36220063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume a8685e4b-6db9-4eb3-9962-369cd76711c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8685e4b-6db9-4eb3-9962-369cd76711c8', 'volume_size': 1} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-d683a3af-e228-4ec1-bbc7-a24abacbe09c-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:27 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.374s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8958dcd0-a882-4f40-b7f6-c4707d336008 tempest-VolumeDependencyTests-427957474 None] Create snapshot completed successfully Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Deleted volume successfully. Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31175221-9ab7-4f2c-b315-c0d4b9ec8bb1 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-a852927d-36cb-4179-92a3-10b5875baa3c-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:27 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-quobyte-d683a3af-e228-4ec1-bbc7-a24abacbe09c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-d683a3af-e228-4ec1-bbc7-a24abacbe09c" acquired by "delete_volume" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4aaec4-66c1-472c-90a9-357594224986]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (7eea05f1-f11f-45a9-92b2-75386e57ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06a7ab7-a75d-4713-81d5-47f8b98d4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c Aug 28 09:07:28 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06a7ab7-a75d-4713-81d5-47f8b98d4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957664854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed48d4-0400-46d4-a16a-42959f3d0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e64e3ea-ec07-4b13-b57e-03504499e831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e64e3ea-ec07-4b13-b57e-03504499e831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81595218-185a-405f-b564-8cb2eab6e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81595218-185a-405f-b564-8cb2eab6e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ed48d4-0400-46d4-a16a-42959f3d0867', 'volume_name': 'volume-d5ed48d4-0400-46d4-a16a-42959f3d0867', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae4343-5805-4e8a-bb06-75d667bff5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae4343-5805-4e8a-bb06-75d667bff5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e43009-205b-46f9-a7f2-d3be6a339f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume d5ed48d4-0400-46d4-a16a-42959f3d0867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ed48d4-0400-46d4-a16a-42959f3d0867', 'volume_size': 1} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:28 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1073741824" returned: 0 in 0.642s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:28 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 Aug 28 09:07:28 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:28 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (e8e306db-ea51-4417-9b79-43ce97e166fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb74da65-b669-4b51-a14d-d492cc008b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c" returned: 0 in 0.513s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb74da65-b669-4b51-a14d-d492cc008b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215812498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6faa4ee-64d0-4f2b-84a7-c5f0d30e5daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6faa4ee-64d0-4f2b-84a7-c5f0d30e5daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c1e942-719c-4f7f-a19a-7b5c06e15ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c1e942-719c-4f7f-a19a-7b5c06e15ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8', 'volume_name': 'volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b4b4ce-aa86-415e-bf8d-900c2d735bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b4b4ce-aa86-415e-bf8d-900c2d735bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f2362-9871-4f21-8cbf-4afa1b1b7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:28 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume 6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8', 'volume_size': 1} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:28 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000" returned: 0 in 0.305s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261140290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68666666-518e-41d9-951f-ac05df50c0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:27Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume 68666666-518e-41d9-951f-ac05df50c0ae {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:28 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:28 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae 1073741824 Aug 28 09:07:28 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Attempting download of 80c9d4d1-e917-4f2a-9c4e-d5d14835342d ((None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}])) to volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f7e6ed-4b5e-44a5-9899-10d65e1ac7b2]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:28 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d683a3af-e228-4ec1-bbc7-a24abacbe09c" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-d683a3af-e228-4ec1-bbc7-a24abacbe09c" released by "delete_volume" :: held 0.929s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:28 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78 Aug 28 09:07:28 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Created reservations ['e63a6096-94e5-4a63-ab96-d5b163c8e37f', 'c73dd9eb-c7b8-4339-b8a9-4ada0fa8e2a8', 'dcdc87c6-e566-48da-80ee-b8ce988dcf84', 'dd3e12ea-3194-4b4f-bbc5-f5b17aa1fadb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:29 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:29 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:29 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78" returned: 0 in 0.474s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:29 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae 1073741824" returned: 0 in 0.605s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:29 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae Aug 28 09:07:29 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:29 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78 Aug 28 09:07:29 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:29 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Flow 'volume_create_manager' (07307c7a-8daf-4fee-b564-e72f15f1e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1cab5a-8ce6-4478-9958-9e931231bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Deleted volume successfully. Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1cab5a-8ce6-4478-9958-9e931231bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1828791015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad93e4f7-0fb7-4994-a26e-3fda441908f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64171a8f3aba49b086405a26da84e698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c477a5b9-6309-4c1c-89c0-cee498d54a34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:29Z,use_quota=True,user_id='a2707d6c929f41688a1f5cb58d72e6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3f971-f634-417d-82c4-2a07a1059dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b3f971-f634-417d-82c4-2a07a1059dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d0442-18ac-4c87-b63b-c3d0891c68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d0442-18ac-4c87-b63b-c3d0891c68a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad93e4f7-0fb7-4994-a26e-3fda441908f4', 'volume_name': 'volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4', 'volume_size': 1, 'snapshot_id': 'c477a5b9-6309-4c1c-89c0-cee498d54a34'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e55f62-27ce-4206-a592-096544439f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e55f62-27ce-4206-a592-096544439f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36792437-4190-49e9-b1e4-7092ecfaeb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Volume ad93e4f7-0fb7-4994-a26e-3fda441908f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4', 'volume_size': 1, 'snapshot_id': 'c477a5b9-6309-4c1c-89c0-cee498d54a34'} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5c086f76-fc5a-4f19-8a7c-412a581a1ef7 tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-d683a3af-e228-4ec1-bbc7-a24abacbe09c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:29 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae" returned: 0 in 0.307s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200680249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e7233-dc9c-401f-9a48-dfc78f3172a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:27Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume e37e7233-dc9c-401f-9a48-dfc78f3172a8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:29 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:29 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78" returned: 1 in 0.400s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80c9d4d1-e917-4f2a-9c4e-d5d14835342d_rj7rqu78' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:07:29 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 1073741824 Aug 28 09:07:29 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aaed75-e4f3-4de5-b3ee-ba32242b0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68666666-518e-41d9-951f-ac05df50c0ae', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd53bf1-f524-43a1-b3fc-6257dc4f479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7cc40c-a43c-4656-a43b-ca6f435eb180]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:29 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-68666666-518e-41d9-951f-ac05df50c0ae (68666666-518e-41d9-951f-ac05df50c0ae): created successfully Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd53bf1-f524-43a1-b3fc-6257dc4f479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:29 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (9823092e-287d-4456-99d1-51c29eb9e5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-10cbe5f7-6fe0-47c2-8dda-72a2c8da1cd7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:29 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:29 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-3dc9f645-e7bf-4233-8aea-f2eb7ca97129-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-3dc9f645-e7bf-4233-8aea-f2eb7ca97129-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "cinder-quobyte-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf932eaf-1b8c-4840-8540-0b83163bf726]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 Aug 28 09:07:30 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 1073741824" returned: 0 in 0.560s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD Aug 28 09:07:30 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 Aug 28 09:07:30 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" returned: 0 in 0.440s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] 80c9d4d1-e917-4f2a-9c4e-d5d14835342d was raw, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129 Aug 28 09:07:30 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 Aug 28 09:07:30 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8" returned: 0 in 0.323s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220322714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8685e4b-6db9-4eb3-9962-369cd76711c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume a8685e4b-6db9-4eb3-9962-369cd76711c8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:30 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:30 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 1073741824 Aug 28 09:07:30 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6139219-4c40-43bc-8659-3fffcddfc5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8c475e-0622-44ff-aac2-be70a11994ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:30 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 (e37e7233-dc9c-401f-9a48-dfc78f3172a8): created successfully Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8c475e-0622-44ff-aac2-be70a11994ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (a266229c-cd4a-44e0-a5f8-cfbfe96a65be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:30 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0e8a6547-fced-4234-9f43-685042eb6b12 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:30 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-quobyte-3dc9f645-e7bf-4233-8aea-f2eb7ca97129" released by "delete_volume" :: held 0.808s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:30 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Created reservations ['0acf472f-90fe-48ec-89d6-6a7e0ada497c', '110dd3ef-0889-41b3-bb27-29205cfc3a6d', '2873c201-851e-4e4e-b3af-6552b88fe4fe', 'db203568-7d37-458e-a3c2-ffa553f26f23'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:31 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:31 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:31 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000" returned: 0 in 0.671s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80c9d4d1-e917-4f2a-9c4e-d5d14835342d__u_lim3rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:31 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1G Aug 28 09:07:31 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:31 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 1073741824" returned: 0 in 0.669s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:31 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Deleted volume successfully. Aug 28 09:07:31 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 Aug 28 09:07:31 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9e2e83ad-36ca-47a3-a247-c5aac02b384a tempest-CreateVolumesFromImageTest-1494079356 None] Lock "cinder-3dc9f645-e7bf-4233-8aea-f2eb7ca97129-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:31 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8" returned: 0 in 0.301s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957664854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed48d4-0400-46d4-a16a-42959f3d0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume d5ed48d4-0400-46d4-a16a-42959f3d0867 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:31 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 1G" returned: 0 in 0.482s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Downloaded image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d ((None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}])) to volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Temporary image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d for user a6fcc2602505493eb3e837e61ebe5017 is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Marking volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:07:31 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 1073741824 Aug 28 09:07:31 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03bca7c-5489-40f6-8321-78db36220063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8685e4b-6db9-4eb3-9962-369cd76711c8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2281ac-b78c-4222-aa9d-6bbe70896787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Copying metadata from image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d to 4b5faad9-7c4c-4349-8b65-a1d61eebf000. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Creating volume glance metadata for volume 4b5faad9-7c4c-4349-8b65-a1d61eebf000 backed by image 80c9d4d1-e917-4f2a-9c4e-d5d14835342d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '09ae70bda677b565d14df48c3142a8bf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 (a8685e4b-6db9-4eb3-9962-369cd76711c8): created successfully Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2281ac-b78c-4222-aa9d-6bbe70896787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (56c5475e-18cd-45d9-ae18-79dfd79c7da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-204ed861-d271-45f5-8676-f5aa37658881 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f5a629-599d-4237-b7ad-44526500cc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000', 'volume_size': 1, 'image_id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09ae70bda677b565d14df48c3142a8bf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ecb627593c3452a8af0476060fc10c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04a0d53f7e45ff3f7dc4afabb3112efe06c2f92b9fc14a996b4dfdeeb93100d6cb4cc8d2ca97c05dac3853d3a8d0b6e8f67ff21c849e6a5923c9463eddbc1abd', 'id': '80c9d4d1-e917-4f2a-9c4e-d5d14835342d', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80c9d4d1-e917-4f2a-9c4e-d5d14835342d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2384d13e-770b-4c1c-8189-03f44ecf9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Volume volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 (4b5faad9-7c4c-4349-8b65-a1d61eebf000): created successfully Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2384d13e-770b-4c1c-8189-03f44ecf9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:31 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Flow 'volume_create_manager' (91f32d09-d2bf-4639-8076-0119ccd0df00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-beb1d109-ff0e-4d72-9a6a-9ac86ab5f4a9 tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Created volume successfully. Aug 28 09:07:32 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 1073741824" returned: 0 in 0.545s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:32 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 Aug 28 09:07:32 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:32 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867" returned: 0 in 0.291s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215812498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90db2ffc93d24872b1fc058cd1ba3237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:28Z,use_quota=True,user_id='3f780c8d229c4fec997d84a97a334028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Creating volume 6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:32 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Acquiring lock "cinder-4b5faad9-7c4c-4349-8b65-a1d61eebf000-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:32 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 1073741824 Aug 28 09:07:32 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e43009-205b-46f9-a7f2-d3be6a339f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ed48d4-0400-46d4-a16a-42959f3d0867', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ebf0e3-9beb-44a5-b3c0-0d8eb9880cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "cinder-4b5faad9-7c4c-4349-8b65-a1d61eebf000-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 (d5ed48d4-0400-46d4-a16a-42959f3d0867): created successfully Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ebf0e3-9beb-44a5-b3c0-0d8eb9880cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (7eea05f1-f11f-45a9-92b2-75386e57ca16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e565bfe0-c16b-4ce0-94b1-fa2a90c31a81 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Acquiring lock "cinder-quobyte-4b5faad9-7c4c-4349-8b65-a1d61eebf000" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "cinder-quobyte-4b5faad9-7c4c-4349-8b65-a1d61eebf000" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce413a8-acc5-4d28-9293-a66e87f9c1eb]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:33 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 Aug 28 09:07:33 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:33 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 1073741824" returned: 0 in 0.646s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:33 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000" returned: 0 in 0.448s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:33 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000 Aug 28 09:07:33 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:33 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 Aug 28 09:07:33 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:33 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-4b5faad9-7c4c-4349-8b65-a1d61eebf000" returned: 0 in 0.313s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:33 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" returned: 0 in 0.292s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "cinder-quobyte-4b5faad9-7c4c-4349-8b65-a1d61eebf000" released by "delete_volume" :: held 0.823s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.086s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34-ad93e4f7-0fb7-4994-a26e-3fda441908f4" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f2362-9871-4f21-8cbf-4afa1b1b7387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7090799-a494-4223-81de-7b34528fd255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34-ad93e4f7-0fb7-4994-a26e-3fda441908f4" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Creating volume ad93e4f7-0fb7-4994-a26e-3fda441908f4 from snapshot c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:33 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Volume volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 (6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8): created successfully Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7090799-a494-4223-81de-7b34528fd255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Flow 'volume_create_manager' (e8e306db-ea51-4417-9b79-43ce97e166fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] snapshot: c477a5b9-6309-4c1c-89c0-cee498d54a34, volume: ad93e4f7-0fb7-4994-a26e-3fda441908f4, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:07:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-baa5e7d5-0626-4100-a29e-5cb80b66056a tempest-CreateVolumesFromSnapshotTest-187804604 None] Created volume successfully. Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df9598-4b76-4966-8a50-90e472120155]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Created reservations ['29d03520-aa21-4ecc-909d-33bf89e12b08', 'af21e4ed-45b3-4690-a466-e74c66e20464', 'bee6a41b-2d60-4b8b-916a-9be5c648dd68', 'f8efe502-f5ba-410b-9d0a-c6cade33c5ee'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:33 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:33 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:33 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:33 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:34 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:34 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d389df-f550-43ca-90ed-f24366367291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:07:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Deleted volume successfully. Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d7c4e-270e-49b5-8970-382dcdf44316]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cb08f0a8-909e-4957-a170-02c2b76ac0db tempest-VolumeAndVolumeTypeFromImageTest-2071179359 None] Lock "cinder-4b5faad9-7c4c-4349-8b65-a1d61eebf000-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:34 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:34 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:34 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.416s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:34 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 Aug 28 09:07:34 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" acquired by "delete_volume" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ae01f-8e73-4bb7-9afb-7138bde28802]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:35 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 Aug 28 09:07:35 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:35 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" returned: 0 in 0.611s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:35 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8 Aug 28 09:07:35 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:36 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" returned: 0 in 0.858s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8" released by "delete_volume" :: held 1.565s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['cbc40f8c-f354-468f-88e9-39da0970a5e3', '9a5408a9-cbd1-4b5c-9e9c-0f01ae77ac72', '137a642a-6132-45ea-9847-8dc568a2fbaf', '21d942ad-28f1-4908-9a43-72c0f384dc12'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:36 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:36 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:37 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.742s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:37 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b539086d-6c36-4bc1-9664-157f0d824401 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-6cd6a5d6-2b7b-44aa-890a-59b44e6e69a8-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-d5ed48d4-0400-46d4-a16a-42959f3d0867-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:37 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-d5ed48d4-0400-46d4-a16a-42959f3d0867-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-d5ed48d4-0400-46d4-a16a-42959f3d0867" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-d5ed48d4-0400-46d4-a16a-42959f3d0867" acquired by "delete_volume" :: waited 0.073s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90db7e3-a8c1-4ebf-a23a-e30449816469]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:38 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 Aug 28 09:07:38 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:39 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867" returned: 0 in 0.918s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:39 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867 Aug 28 09:07:39 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:39 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d5ed48d4-0400-46d4-a16a-42959f3d0867" returned: 0 in 0.521s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-d5ed48d4-0400-46d4-a16a-42959f3d0867" released by "delete_volume" :: held 1.563s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:39 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['192ad08c-d9f1-4636-9ff0-b70b09c51a07', '5d696db4-167b-40c8-a1d5-092abe62ef84', '4ead3042-db36-465d-8968-fb38e412235b', 'f3a56c77-4eab-4e4b-8de4-5beb0e2e3850'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:40 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:40 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:40 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:40 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-a8685e4b-6db9-4eb3-9962-369cd76711c8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-a8685e4b-6db9-4eb3-9962-369cd76711c8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-a8685e4b-6db9-4eb3-9962-369cd76711c8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-a8685e4b-6db9-4eb3-9962-369cd76711c8" acquired by "delete_volume" :: waited 0.045s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d03c83-cdf8-47fe-ad46-4c250ad55fde]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:41 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.083s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:41 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 Aug 28 09:07:41 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5023b1e5-34a9-4220-86e7-21e8902b3d20 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-d5ed48d4-0400-46d4-a16a-42959f3d0867-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:41 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 1.003s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:07:41 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4" returned: 0 in 7.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:07:41 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Converted 1024.00 MB image at 140.96 MB/s Aug 28 09:07:41 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 is being set with open permissions: ugo+rw Aug 28 09:07:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:42 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8" returned: 0 in 1.066s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:42 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 Aug 28 09:07:42 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:42 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8 Aug 28 09:07:42 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:42 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4" returned: 0 in 0.395s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" released by "_copy_volume_from_snapshot" :: held 8.638s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34-ad93e4f7-0fb7-4994-a26e-3fda441908f4" released by "_create_volume_from_snapshot" :: held 8.770s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.812s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:42 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a8685e4b-6db9-4eb3-9962-369cd76711c8" returned: 0 in 0.468s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-a8685e4b-6db9-4eb3-9962-369cd76711c8" released by "delete_volume" :: held 1.676s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36792437-4190-49e9-b1e4-7092ecfaeb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4', 'volume_size': 1, 'snapshot_id': 'c477a5b9-6309-4c1c-89c0-cee498d54a34'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88d610c-9a6c-4468-be53-7f5d623df4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Volume volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 (ad93e4f7-0fb7-4994-a26e-3fda441908f4): created successfully Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88d610c-9a6c-4468-be53-7f5d623df4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Flow 'volume_create_manager' (07307c7a-8daf-4fee-b564-e72f15f1e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7114d2d0-16b0-4ded-9cbe-cacc7b23a943 tempest-VolumeDependencyTests-427957474 None] Created volume successfully. Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['741000ce-c249-4047-8edb-c3d88a23455f', '8b1151e5-f28e-48a1-a14e-abe03249f773', '06f03f31-d395-4a1b-b50a-8bfb6f84640d', 'af486dbb-7409-4728-8970-4b7fa2c2d6f1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:42 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:42 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:42 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.290s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1a0fdd60-8444-4bf7-a8ce-e446a73e4c3a tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-a8685e4b-6db9-4eb3-9962-369cd76711c8-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-e37e7233-dc9c-401f-9a48-dfc78f3172a8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-e37e7233-dc9c-401f-9a48-dfc78f3172a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-e37e7233-dc9c-401f-9a48-dfc78f3172a8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-e37e7233-dc9c-401f-9a48-dfc78f3172a8" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c0a13-0a3f-4d81-a7ed-64b5146a730e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-c477a5b9-6309-4c1c-89c0-cee498d54a34-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:43 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 Aug 28 09:07:43 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-c477a5b9-6309-4c1c-89c0-cee498d54a34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Deleting offline snapshot c477a5b9-6309-4c1c-89c0-cee498d54a34 of volume b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] snapshot_file for this snap is: volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274e472-a275-4f70-9b1b-aaa129169e54]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:43 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:43 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:43 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:43 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8 Aug 28 09:07:43 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:43 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.476s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d389df-f550-43ca-90ed-f24366367291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eac6bb9-5161-4712-8e0f-44e6478681ea]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:44 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e37e7233-dc9c-401f-9a48-dfc78f3172a8" returned: 0 in 0.327s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-e37e7233-dc9c-401f-9a48-dfc78f3172a8" released by "delete_volume" :: held 0.874s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['fb4d1a89-c9ca-48b1-ac46-69f030f37860', 'c82f5895-6210-42cf-9d75-6157f067e435', '6774908d-00c6-44c7-8933-66a83e8a988e', 'db1dc84b-4146-491a-abfa-580dd98c0fd9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:44 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:44 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:44 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:44 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-68666666-518e-41d9-951f-ac05df50c0ae-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-68666666-518e-41d9-951f-ac05df50c0ae-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-68666666-518e-41d9-951f-ac05df50c0ae" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-68666666-518e-41d9-951f-ac05df50c0ae" acquired by "delete_volume" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf00765-3b3e-4c6c-a6df-188d6d04f036]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:44 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.458s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:44 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:44 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-217e1778-c0d0-4c37-bd65-cdb2bf8a7439 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-e37e7233-dc9c-401f-9a48-dfc78f3172a8-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.790s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:44 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:44 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:44 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae Aug 28 09:07:44 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:45 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae" returned: 0 in 0.567s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:45 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.446s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:45 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae Aug 28 09:07:45 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:45 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34 Aug 28 09:07:45 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:45 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68666666-518e-41d9-951f-ac05df50c0ae" returned: 0 in 0.324s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:45 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291.c477a5b9-6309-4c1c-89c0-cee498d54a34" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-68666666-518e-41d9-951f-ac05df50c0ae" released by "delete_volume" :: held 0.969s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-c477a5b9-6309-4c1c-89c0-cee498d54a34" released by "_delete_snapshot" :: held 2.212s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" released by "delete_snapshot" :: held 2.248s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Flow 'volume_create_manager' (78a334d0-faed-4d8a-9c35-98efe0023070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648c441a-c182-435a-81a8-dfa6e1137d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648c441a-c182-435a-81a8-dfa6e1137d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf67a9-e439-4cd9-86df-ce4b50f09ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f78122cd49ec8fd8fdf7e4ecbe26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:46Z,use_quota=True,user_id='94e7a6a6c8744c4bb2a658b720f32d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c43fe0-d159-4eb1-b6cf-205c4a93b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c43fe0-d159-4eb1-b6cf-205c4a93b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a75fe6-1a8d-441e-85da-17757cfca1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a75fe6-1a8d-441e-85da-17757cfca1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cf67a9-e439-4cd9-86df-ce4b50f09ddc', 'volume_name': 'volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a0963-e4f0-434d-b6f6-337c2a1c3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a0963-e4f0-434d-b6f6-337c2a1c3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0830462a-8726-49c4-9915-4405dbfe9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:45 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Volume 66cf67a9-e439-4cd9-86df-ce4b50f09ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc', 'volume_size': 1} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf67a9-e439-4cd9-86df-ce4b50f09ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f78122cd49ec8fd8fdf7e4ecbe26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:46Z,use_quota=True,user_id='94e7a6a6c8744c4bb2a658b720f32d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Creating volume 66cf67a9-e439-4cd9-86df-ce4b50f09ddc {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['2a7b4790-246f-4da5-8d66-38197e38c48a', '65919c07-43e1-4b97-9c53-5353319bdcda', '2a1a4770-e6ea-45a6-a402-d1451d73545e', '8c5185b5-bef0-4fed-b515-c4ce3efa3363'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:45 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc 1073741824 Aug 28 09:07:45 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Created reservations ['9b16fddb-cf13-4836-831f-28404373f3ed', '5ae02ee8-5b6b-48a1-b450-e696ef2866c4', '9aae46c7-7cda-41a2-ba26-8a3241e2100a', 'da36ff67-60da-4960-8b15-686812c8b448'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:45 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:46 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Delete snapshot completed successfully. Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7da5c236-89cb-4cd2-9fe1-b9db020366c3 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-c477a5b9-6309-4c1c-89c0-cee498d54a34-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:46 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.312s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b73431ac-c072-495c-9226-5611e8fff1f7 tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-68666666-518e-41d9-951f-ac05df50c0ae-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:46 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc 1073741824" returned: 0 in 0.594s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:46 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc Aug 28 09:07:46 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-b2d389df-f550-43ca-90ed-f24366367291-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-b2d389df-f550-43ca-90ed-f24366367291-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:46 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-0b7ad3f7-a349-4680-9ce0-680df07442f4-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5a5b8-1c0f-4cc1-bba9-0964dbbcd8e5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0830462a-8726-49c4-9915-4405dbfe9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef5e900-df2d-468e-84e0-6497fc41b91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Volume volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc (66cf67a9-e439-4cd9-86df-ce4b50f09ddc): created successfully Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef5e900-df2d-468e-84e0-6497fc41b91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Flow 'volume_create_manager' (78a334d0-faed-4d8a-9c35-98efe0023070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-0b7ad3f7-a349-4680-9ce0-680df07442f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:46 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-0b7ad3f7-a349-4680-9ce0-680df07442f4" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b3a3cca7-8b9f-498c-8f22-6379b49ea7e9 tempest-CinderUnicodeTest-2042001609 None] Created volume successfully. Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-0b7ad3f7-a349-4680-9ce0-680df07442f4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleting offline snapshot 0b7ad3f7-a349-4680-9ce0-680df07442f4 of volume ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] snapshot_file for this snap is: volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:07:47 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:47 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd010e-1e36-4ca2-b6d3-76d6d88b0cd2]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:47 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 Aug 28 09:07:47 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:47 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.483s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:47 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291 Aug 28 09:07:47 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:47 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4" returned: 0 in 0.456s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689f9fa-bc7e-4da9-8c71-566c1f1dc04c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:47 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b2d389df-f550-43ca-90ed-f24366367291" returned: 0 in 0.321s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-b2d389df-f550-43ca-90ed-f24366367291" released by "delete_volume" :: held 0.938s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:47 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb Aug 28 09:07:47 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Created reservations ['d6454f6e-db4e-40f3-bf54-cd7ece0e5d45', '8adb0995-4033-412b-a4e2-90d0a9eed790', 'f6ae1c3b-7523-43a1-aaf3-8aabc3aa08ef', 'efe79566-d75a-4eaa-8267-f5cd59ea0579'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:48 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:48 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-ad93e4f7-0fb7-4994-a26e-3fda441908f4-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "cinder-ad93e4f7-0fb7-4994-a26e-3fda441908f4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:48 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb" returned: 0 in 0.585s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Acquiring lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:48 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 Aug 28 09:07:48 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" acquired by "delete_volume" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a4233-e7f0-463f-9d21-aaaa8eca7352]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:48 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.595s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:48 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 Aug 28 09:07:48 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Deleted volume successfully. Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Flow 'volume_create_manager' (fe7cbae4-a02a-4354-831e-2e687dc1c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e108591-e25a-4126-82e9-162a07117fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e108591-e25a-4126-82e9-162a07117fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-268265882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26937322-1cae-4f3d-bcc2-d8dd1c3db124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f78122cd49ec8fd8fdf7e4ecbe26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:48Z,use_quota=True,user_id='94e7a6a6c8744c4bb2a658b720f32d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dc3ce1-0272-4fe8-8c11-a4c98ebfb200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dc3ce1-0272-4fe8-8c11-a4c98ebfb200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27095404-6eb8-4788-8d20-0cfdf1892a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27095404-6eb8-4788-8d20-0cfdf1892a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26937322-1cae-4f3d-bcc2-d8dd1c3db124', 'volume_name': 'volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d767b-5356-4578-a929-dfbc1d3078dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d767b-5356-4578-a929-dfbc1d3078dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ea85b4-d5d8-4a15-bed2-4127dfcb8621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:48 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Volume 26937322-1cae-4f3d-bcc2-d8dd1c3db124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124', 'volume_size': 1} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-268265882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26937322-1cae-4f3d-bcc2-d8dd1c3db124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d9f78122cd49ec8fd8fdf7e4ecbe26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:48Z,use_quota=True,user_id='94e7a6a6c8744c4bb2a658b720f32d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Creating volume 26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:48 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:48 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-546ebbb9-7a62-4092-a6f9-ed979a576df6 tempest-VolumeDependencyTests-427957474 None] Lock "cinder-b2d389df-f550-43ca-90ed-f24366367291-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4" returned: 0 in 0.560s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:48 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 1073741824 Aug 28 09:07:48 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:48 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4 Aug 28 09:07:48 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:49 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4" returned: 0 in 0.706s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:49 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4 Aug 28 09:07:49 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:49 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb.0b7ad3f7-a349-4680-9ce0-680df07442f4" returned: 0 in 0.337s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-0b7ad3f7-a349-4680-9ce0-680df07442f4" released by "_delete_snapshot" :: held 2.099s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" released by "delete_snapshot" :: held 2.140s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['e2e5d98e-90d3-4e3f-800b-fd8eea7efcc1', 'd8f392cc-8016-419e-a805-9cb700419943', '0c5e7617-217e-474e-828e-2dd120f34b56', 'f0f80af6-e7d0-4550-9a27-aa97c9aeb7a9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Delete snapshot completed successfully. Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-e5a0a965-0e2d-4e3b-9d8a-de9e33f4815f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-0b7ad3f7-a349-4680-9ce0-680df07442f4-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:49 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 1073741824" returned: 0 in 0.633s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ad93e4f7-0fb7-4994-a26e-3fda441908f4" returned: 0 in 0.343s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "cinder-quobyte-ad93e4f7-0fb7-4994-a26e-3fda441908f4" released by "delete_volume" :: held 1.120s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:49 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 Aug 28 09:07:49 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Created reservations ['0d3f4d8d-39e9-4279-b0fd-691a4dbddaf0', 'dabd30ec-26b6-4832-8c8e-6e8a4ff028f6', '637842a2-5f26-48a6-8c96-e5d3cd095196', '85d602fa-17db-40cc-b78d-d062b6b9f945'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:49 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:49 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:49 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124" returned: 0 in 0.311s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ea85b4-d5d8-4a15-bed2-4127dfcb8621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12156fe-eb91-4c0d-99a6-dbe8c2d3a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:49 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Volume volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 (26937322-1cae-4f3d-bcc2-d8dd1c3db124): created successfully Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12156fe-eb91-4c0d-99a6-dbe8c2d3a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Flow 'volume_create_manager' (fe7cbae4-a02a-4354-831e-2e687dc1c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-33dd8e9b-7771-4e66-a97c-8805c60d9522 tempest-CinderUnicodeTest-2042001609 None] Created volume successfully. Aug 28 09:07:49 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.284s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Deleted volume successfully. Aug 28 09:07:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-67fb0383-3951-4874-bb18-8b107d1ca62a tempest-VolumeDependencyTests-427957474 None] Lock "cinder-ad93e4f7-0fb7-4994-a26e-3fda441908f4-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-ff1c67b4-0612-4d36-8741-bc7de63e90bb-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-ff1c67b4-0612-4d36-8741-bc7de63e90bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[52569c87-502b-4572-82c9-71522c6a3f2e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:50 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb Aug 28 09:07:50 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:50 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb" returned: 0 in 0.471s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:50 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb Aug 28 09:07:50 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Creating offline snapshot 631e8cfb-4c59-4ef0-9bfb-1613db746355 of volume 26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b0f9a-42c4-4c2f-bc10-68b4ddc3a1d0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:51 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ff1c67b4-0612-4d36-8741-bc7de63e90bb" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-quobyte-ff1c67b4-0612-4d36-8741-bc7de63e90bb" released by "delete_volume" :: held 0.969s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:51 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Created reservations ['433b953e-95b2-46e6-a892-e13e412f5ff7', '3da270e9-a9d7-4a7e-8c6f-c4d40aa18449', '6093804b-5a9f-4073-b4d2-870a203fe03f', '691a1427-94d5-4e72-bb5a-449b183b6a49'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:51 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:51 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:51 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:51 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124" returned: 0 in 0.500s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:51 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 1G Aug 28 09:07:51 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:51 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.380s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Deleted volume successfully. Aug 28 09:07:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f70fb03d-a86a-4fe5-b75d-cd8fbaaf910f tempest-CreateVolumesFromSnapshotTest-187804604 None] Lock "cinder-ff1c67b4-0612-4d36-8741-bc7de63e90bb-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Flow 'volume_create_manager' (8e5a3d0d-64ec-4a63-a0a7-f0472615ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973ae03c-dbe6-4471-a1e0-384568082680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973ae03c-dbe6-4471-a1e0-384568082680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588414883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed28a154-89f8-4b89-8ba6-5f89692bd419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511d419c48854957a24bbd0caed51594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:52Z,use_quota=True,user_id='0c9db44dc0bd4e12bb4b2aa1af13955e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f351bcf-a0fe-45be-9316-08b1aee881cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f351bcf-a0fe-45be-9316-08b1aee881cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389424bb-f159-47d1-bdf9-dbb3e730d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389424bb-f159-47d1-bdf9-dbb3e730d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed28a154-89f8-4b89-8ba6-5f89692bd419', 'volume_name': 'volume-ed28a154-89f8-4b89-8ba6-5f89692bd419', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3560ff16-8d04-41a6-8fc1-d476705d5fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3560ff16-8d04-41a6-8fc1-d476705d5fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e2dbf7-b8db-4a4a-a92f-43ab80e94d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:52 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Volume ed28a154-89f8-4b89-8ba6-5f89692bd419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed28a154-89f8-4b89-8ba6-5f89692bd419', 'volume_size': 1} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:52 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 1G" returned: 0 in 0.590s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:52 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 Aug 28 09:07:52 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:52 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:52 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 is being set with open permissions: ugo+rw Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:52 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 Aug 28 09:07:52 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:52 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355" returned: 0 in 0.296s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:52 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info Aug 28 09:07:52 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:53 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:53 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info is being set with open permissions: ugo+rw Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:53 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info Aug 28 09:07:53 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:53 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.info" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588414883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed28a154-89f8-4b89-8ba6-5f89692bd419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511d419c48854957a24bbd0caed51594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:52Z,use_quota=True,user_id='0c9db44dc0bd4e12bb4b2aa1af13955e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Creating volume ed28a154-89f8-4b89-8ba6-5f89692bd419 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:53 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:53 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 1073741824 Aug 28 09:07:53 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:53 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-effefbbc-abba-4213-aff7-e42864d45876 tempest-CinderUnicodeTest-2042001609 None] Create snapshot completed successfully Aug 28 09:07:54 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 1073741824" returned: 0 in 0.549s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:54 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 Aug 28 09:07:54 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-631e8cfb-4c59-4ef0-9bfb-1613db746355-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-631e8cfb-4c59-4ef0-9bfb-1613db746355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-quobyte-631e8cfb-4c59-4ef0-9bfb-1613db746355" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-631e8cfb-4c59-4ef0-9bfb-1613db746355" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Deleting offline snapshot 631e8cfb-4c59-4ef0-9bfb-1613db746355 of volume 26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] snapshot_file for this snap is: volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56221d-9673-4c77-b784-7f72a7e01a20]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:54 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419" returned: 0 in 0.351s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e2dbf7-b8db-4a4a-a92f-43ab80e94d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed28a154-89f8-4b89-8ba6-5f89692bd419', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfca47f-e30b-4e68-b50b-b351f6930641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:54 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 Aug 28 09:07:54 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Volume volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 (ed28a154-89f8-4b89-8ba6-5f89692bd419): created successfully Aug 28 09:07:54 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfca47f-e30b-4e68-b50b-b351f6930641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Flow 'volume_create_manager' (8e5a3d0d-64ec-4a63-a0a7-f0472615ad76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-94139363-d721-4216-9c59-61080b1f5d89 tempest-ProjectReaderTests-1700221151 None] Created volume successfully. Aug 28 09:07:54 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355" returned: 0 in 0.457s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b1cbc-f862-485a-9cbb-5f7cbc5a2953]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:55 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 Aug 28 09:07:55 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:55 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124" returned: 0 in 0.454s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:55 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 Aug 28 09:07:55 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "cinder-ed28a154-89f8-4b89-8ba6-5f89692bd419-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "cinder-ed28a154-89f8-4b89-8ba6-5f89692bd419-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "cinder-quobyte-ed28a154-89f8-4b89-8ba6-5f89692bd419" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "cinder-quobyte-ed28a154-89f8-4b89-8ba6-5f89692bd419" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693a4fa-f1f1-4778-bffa-8f4a1e36a4a7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:55 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355" returned: 0 in 0.527s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:55 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 Aug 28 09:07:55 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:55 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355 Aug 28 09:07:55 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (9c51ffae-8ad0-4dc5-97d1-ff85c41586e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78825e0b-1bb1-4bbe-b508-5f6463fc5d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78825e0b-1bb1-4bbe-b508-5f6463fc5d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405101467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ade941-7e1e-45be-8e8a-65aaf01eda09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:56Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb38d17-779b-4cb7-b9be-6b8374f417fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb38d17-779b-4cb7-b9be-6b8374f417fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3a550-94ed-415b-bad9-395c95471b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3a550-94ed-415b-bad9-395c95471b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ade941-7e1e-45be-8e8a-65aaf01eda09', 'volume_name': 'volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b34f7e5-8349-4d43-a092-56afe9d86184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b34f7e5-8349-4d43-a092-56afe9d86184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648a9c31-7395-43c4-b4e4-f6c5abfc0c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:56 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume d8ade941-7e1e-45be-8e8a-65aaf01eda09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09', 'volume_size': 1} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405101467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ade941-7e1e-45be-8e8a-65aaf01eda09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:56Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume d8ade941-7e1e-45be-8e8a-65aaf01eda09 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:56 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:56 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419" returned: 0 in 0.515s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:56 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:56 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 1073741824 Aug 28 09:07:56 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124.631e8cfb-4c59-4ef0-9bfb-1613db746355" returned: 0 in 0.362s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:56 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419 Aug 28 09:07:56 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-631e8cfb-4c59-4ef0-9bfb-1613db746355" released by "_delete_snapshot" :: held 1.936s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" released by "delete_snapshot" :: held 1.980s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Created reservations ['ec966920-6866-4093-a3a2-d84922996672', '44ce8aed-6e9f-45ef-b822-b8f6f618fa61', 'cee4cda0-4454-4bae-997d-6119abfff7fa', '1f0ae00c-95d7-4bd0-be58-c9517e3e49f3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Delete snapshot completed successfully. Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f93ae6d5-b73e-404e-8c4f-8750561b64f2 tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-631e8cfb-4c59-4ef0-9bfb-1613db746355-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:56 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ed28a154-89f8-4b89-8ba6-5f89692bd419" returned: 0 in 0.357s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "cinder-quobyte-ed28a154-89f8-4b89-8ba6-5f89692bd419" released by "delete_volume" :: held 0.924s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-26937322-1cae-4f3d-bcc2-d8dd1c3db124-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-26937322-1cae-4f3d-bcc2-d8dd1c3db124-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Created reservations ['37e14c05-f63a-40b0-ab2b-6d7d6b4cb316', 'd109ae44-e140-46cb-9aea-92845fdc5e53', '82ede5f4-bceb-4a4c-aae9-9e7915d32b99', 'e334a8b4-f1e2-4a30-8a65-07750d84fb1f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14810a-18be-45d7-8bd8-a5b6feca49f7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:56 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 1073741824" returned: 0 in 0.634s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:56 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:56 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:56 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 Aug 28 09:07:56 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:56 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 Aug 28 09:07:56 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:57 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648a9c31-7395-43c4-b4e4-f6c5abfc0c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb974d-49f8-463f-9349-c216eadf8896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:57 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.394s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:57 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 (d8ade941-7e1e-45be-8e8a-65aaf01eda09): created successfully Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb974d-49f8-463f-9349-c216eadf8896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:57 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (9c51ffae-8ad0-4dc5-97d1-ff85c41586e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Deleted volume successfully. Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124" returned: 0 in 0.519s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-823327c9-ad5c-459a-be29-6da3b59e5066 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:07:57 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124 Aug 28 09:07:57 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-3baf6e8d-3e83-4b1a-a6c0-4073991cbd44 tempest-ProjectReaderTests-1700221151 None] Lock "cinder-ed28a154-89f8-4b89-8ba6-5f89692bd419-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Flow 'volume_create_manager' (b22e2e27-f0fc-464a-a3c1-e52fc778d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c593a01-a9c4-483d-ac18-40b2ee8416c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:57 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c593a01-a9c4-483d-ac18-40b2ee8416c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca280a-a959-4365-94f5-b6301aa8f2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167158128c4d4b578772f209fab3699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:58Z,use_quota=True,user_id='171f6dc6f34f440294dffac3c5ee22c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4b5090-c8c4-4e78-b95f-f930a0efa298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4b5090-c8c4-4e78-b95f-f930a0efa298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6ba21a-de05-4b74-8632-1a01986fb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.image.glance [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Creating Keystone auth plugin from conf {{(pid=85762) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-26937322-1cae-4f3d-bcc2-d8dd1c3db124" returned: 0 in 0.319s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-26937322-1cae-4f3d-bcc2-d8dd1c3db124" released by "delete_volume" :: held 0.930s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Created reservations ['2e032a11-34f3-4f0c-acb3-deffce18dbd3', '2c4f1f36-49be-4f77-a8a8-24b3b2a93520', 'e46effbc-ba16-40d9-9bca-11b2bc3ce5f8', '2cb90b38-58d0-4273-8df8-c1daffc7f151'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:57 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:07:57 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:58 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.370s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6ba21a-de05-4b74-8632-1a01986fb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5aca280a-a959-4365-94f5-b6301aa8f2c3', 'volume_name': 'volume-5aca280a-a959-4365-94f5-b6301aa8f2c3', 'volume_size': 1, 'image_id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc90c6f223d45a3c24f0c0fa7b9bf457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167158128c4d4b578772f209fab3699d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55cd61aa436a0d0beb1090bcc297bbfa6832abcf700791ec6bba8ee39842487a039b0b86da4744253af16baf038c764ab1502385619e9ebf1884cb9d4b243ccc', 'id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af89011b-1960-47c4-ae63-8cd6c49012b6/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26109d21-9ff6-4c24-be0d-95866cab289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26109d21-9ff6-4c24-be0d-95866cab289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5f8a48-25f7-4ca0-ba0a-026ae34521b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Volume 5aca280a-a959-4365-94f5-b6301aa8f2c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5aca280a-a959-4365-94f5-b6301aa8f2c3', 'volume_size': 1, 'image_id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc90c6f223d45a3c24f0c0fa7b9bf457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167158128c4d4b578772f209fab3699d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55cd61aa436a0d0beb1090bcc297bbfa6832abcf700791ec6bba8ee39842487a039b0b86da4744253af16baf038c764ab1502385619e9ebf1884cb9d4b243ccc', 'id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af89011b-1960-47c4-ae63-8cd6c49012b6/file', 'properties': {}}, 'image_service': } Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Trying to clone 5aca280a-a959-4365-94f5-b6301aa8f2c3 from image af89011b-1960-47c4-ae63-8cd6c49012b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}]). {{(pid=85762) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:07:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Deleted volume successfully. Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c32077af-0ae7-4dc4-937d-2cb66422b42a tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-26937322-1cae-4f3d-bcc2-d8dd1c3db124-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:07:58 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542f862-9a06-46e5-9aeb-de0392f25e12]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Flow 'volume_create_manager' (ec6bd419-d3f6-4e61-8e06-f43131f3d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:58 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:07:58 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae175cbe-d113-4bc7-8573-a4b73b89798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae175cbe-d113-4bc7-8573-a4b73b89798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024683653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f045cdd0-7678-4650-9c0c-553f59c88cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511d419c48854957a24bbd0caed51594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='0c9db44dc0bd4e12bb4b2aa1af13955e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd8900-0f6c-4d94-9cff-b19145ce8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd8900-0f6c-4d94-9cff-b19145ce8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d7fcc-6ebc-445c-b945-358b69bb19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d7fcc-6ebc-445c-b945-358b69bb19c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f045cdd0-7678-4650-9c0c-553f59c88cf3', 'volume_name': 'volume-f045cdd0-7678-4650-9c0c-553f59c88cf3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc2f43-d7be-4aac-a41f-69902052b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc2f43-d7be-4aac-a41f-69902052b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c33478-bcca-42c5-9a6f-9b6b502ce357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:58 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Volume f045cdd0-7678-4650-9c0c-553f59c88cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f045cdd0-7678-4650-9c0c-553f59c88cf3', 'volume_size': 1} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024683653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f045cdd0-7678-4650-9c0c-553f59c88cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511d419c48854957a24bbd0caed51594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='0c9db44dc0bd4e12bb4b2aa1af13955e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Creating volume f045cdd0-7678-4650-9c0c-553f59c88cf3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:58 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:58 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 1073741824 Aug 28 09:07:58 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:58 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-66cf67a9-e439-4cd9-86df-ce4b50f09ddc-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (0cf1b609-15e7-46e2-a991-07fcd9f05f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd984eea-7a57-48eb-a42f-d458ab19fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd984eea-7a57-48eb-a42f-d458ab19fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74337811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c6925-2794-4deb-8c22-6bd08d7c9163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdc9c48-f288-4dca-ab2d-2d4b82baa59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdc9c48-f288-4dca-ab2d-2d4b82baa59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20207380-45e1-4704-a67e-793fdeaf36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20207380-45e1-4704-a67e-793fdeaf36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329c6925-2794-4deb-8c22-6bd08d7c9163', 'volume_name': 'volume-329c6925-2794-4deb-8c22-6bd08d7c9163', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a134d3-aa63-47a2-a3e2-fc62cf2ca6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a134d3-aa63-47a2-a3e2-fc62cf2ca6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e22fe8-c822-4b18-919a-10773d3f1e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume 329c6925-2794-4deb-8c22-6bd08d7c9163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329c6925-2794-4deb-8c22-6bd08d7c9163', 'volume_size': 1} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-66cf67a9-e439-4cd9-86df-ce4b50f09ddc-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:59 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:07:59 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "cinder-quobyte-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[953da59c-d2da-4851-98a3-bf83f673cfe5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 1073741824" returned: 0 in 0.582s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 Aug 28 09:07:59 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:59 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc Aug 28 09:07:59 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:59 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 1 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Temporary image af89011b-1960-47c4-ae63-8cd6c49012b6 is fetched for user 171f6dc6f34f440294dffac3c5ee22c3. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (d8e672e1-3fa6-48ea-904b-6ed42769c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7380853-0f23-4f32-8f12-fdef6a4c9c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7380853-0f23-4f32-8f12-fdef6a4c9c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210855836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877e14bf-d310-46a4-8399-6ade620e529b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d839dce2-5d1b-42d2-8346-4a5387d92948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d839dce2-5d1b-42d2-8346-4a5387d92948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f5673-92b9-4799-bc43-1fc62d2f9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f5673-92b9-4799-bc43-1fc62d2f9f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877e14bf-d310-46a4-8399-6ade620e529b', 'volume_name': 'volume-877e14bf-d310-46a4-8399-6ade620e529b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642c5a81-cff3-4bb2-b476-3e25d5a10010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642c5a81-cff3-4bb2-b476-3e25d5a10010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f12088-a42c-407e-a3b6-77c09c7c27eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume 877e14bf-d310-46a4-8399-6ade620e529b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877e14bf-d310-46a4-8399-6ade620e529b', 'volume_size': 1} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[068ea225-461f-4f57-acd3-46e6b6737f96]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3" returned: 0 in 0.356s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74337811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329c6925-2794-4deb-8c22-6bd08d7c9163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume 329c6925-2794-4deb-8c22-6bd08d7c9163 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:07:59 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c33478-bcca-42c5-9a6f-9b6b502ce357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f045cdd0-7678-4650-9c0c-553f59c88cf3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 1073741824 Aug 28 09:07:59 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7dc742-94d0-458b-b488-e93b7cd82f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:07:59 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Volume volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 (f045cdd0-7678-4650-9c0c-553f59c88cf3): created successfully Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7dc742-94d0-458b-b488-e93b7cd82f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Flow 'volume_create_manager' (ec6bd419-d3f6-4e61-8e06-f43131f3d717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:07:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-23a342c0-b9c6-4eec-9c2a-b2a035c04a34 tempest-ProjectReaderTests-1700221151 None] Created volume successfully. Aug 28 09:07:59 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" returned: 0 in 0.579s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:07:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:07:59 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:07:59 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:07:59 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc Aug 28 09:07:59 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (6f273050-464f-46b1-bc24-326d95733107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:00 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828bdf8d-9073-41cb-a02a-758e16c5bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828bdf8d-9073-41cb-a02a-758e16c5bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520333206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce67f90f-6a26-4577-b733-144ae39cb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:00Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2cf7ca-90e0-471d-972c-57dca85a21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2cf7ca-90e0-471d-972c-57dca85a21bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43700890-8ab4-4a0e-b6e6-6d3bf11d0ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43700890-8ab4-4a0e-b6e6-6d3bf11d0ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce67f90f-6a26-4577-b733-144ae39cb7d8', 'volume_name': 'volume-ce67f90f-6a26-4577-b733-144ae39cb7d8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a59860-cb6d-4c7b-8f96-c8409b6062d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a59860-cb6d-4c7b-8f96-c8409b6062d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f396891d-79b4-4838-908c-7bee67a5b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume ce67f90f-6a26-4577-b733-144ae39cb7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce67f90f-6a26-4577-b733-144ae39cb7d8', 'volume_size': 1} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" returned: 0 in 0.433s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-quobyte-66cf67a9-e439-4cd9-86df-ce4b50f09ddc" released by "delete_volume" :: held 1.074s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:00 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:08:00 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Created reservations ['f1c45a53-511e-45d4-bd05-3a3b5406198d', 'b789b897-be3d-40e1-b559-fe1a4798d2a9', '9e597827-80ca-4be2-89ac-a0728495fe91', '6fcb2d53-a0e7-4cab-9c35-c89bc0d920e0'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:00 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 1073741824" returned: 0 in 0.737s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:00 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:00 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 Aug 28 09:08:00 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:00 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 1 in 0.509s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:00 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163" returned: 0 in 0.342s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210855836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877e14bf-d310-46a4-8399-6ade620e529b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:59Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume 877e14bf-d310-46a4-8399-6ade620e529b {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:00 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Acquiring lock "cinder-f045cdd0-7678-4650-9c0c-553f59c88cf3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:00 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b 1073741824 Aug 28 09:08:00 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.527s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e22fe8-c822-4b18-919a-10773d3f1e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329c6925-2794-4deb-8c22-6bd08d7c9163', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26de202-1246-49bd-8009-88f6483bc6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "cinder-f045cdd0-7678-4650-9c0c-553f59c88cf3-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Deleted volume successfully. Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (458e49b4-dbb9-4a5f-abd5-fa7438c1cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc5b25-aa7a-4c63-9fa5-653b0d0c166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-329c6925-2794-4deb-8c22-6bd08d7c9163 (329c6925-2794-4deb-8c22-6bd08d7c9163): created successfully Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26de202-1246-49bd-8009-88f6483bc6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (0cf1b609-15e7-46e2-a991-07fcd9f05f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc5b25-aa7a-4c63-9fa5-653b0d0c166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314073204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613564f5-0f70-4793-af46-4feb041db951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:01Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865e1ac3-35f0-4e4e-807d-bfc99b7e63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865e1ac3-35f0-4e4e-807d-bfc99b7e63b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c108c86-ce67-43be-b352-46d5b1d163d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c108c86-ce67-43be-b352-46d5b1d163d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613564f5-0f70-4793-af46-4feb041db951', 'volume_name': 'volume-613564f5-0f70-4793-af46-4feb041db951', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2fc238-d4a2-4565-bc8b-34c6577c5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2fc238-d4a2-4565-bc8b-34c6577c5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c035be-1c80-449c-a78e-a64846889dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume 613564f5-0f70-4793-af46-4feb041db951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613564f5-0f70-4793-af46-4feb041db951', 'volume_size': 1} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6f1ef822-2a6c-461a-b47c-2ee28d4cbd2a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Acquiring lock "cinder-quobyte-f045cdd0-7678-4650-9c0c-553f59c88cf3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-51bf856e-fc81-4123-8844-b75d55d8c9bd tempest-CinderUnicodeTest-2042001609 None] Lock "cinder-66cf67a9-e439-4cd9-86df-ce4b50f09ddc-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "cinder-quobyte-f045cdd0-7678-4650-9c0c-553f59c88cf3" acquired by "delete_volume" :: waited 0.042s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (4deefdfc-61d6-4140-b653-1b02708e989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8a9c37-cf03-4090-a7b4-18bdc25f5015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c595dc-bfd6-40dd-80d2-b6cb4120b623]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8a9c37-cf03-4090-a7b4-18bdc25f5015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306678766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85bcba0-9f71-44d9-9fa1-773675553f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:01Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e44ea67-f39b-4a7b-9242-8e98ea340121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e44ea67-f39b-4a7b-9242-8e98ea340121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa588792-283b-4b52-90b1-cae3517b5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa588792-283b-4b52-90b1-cae3517b5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85bcba0-9f71-44d9-9fa1-773675553f95', 'volume_name': 'volume-e85bcba0-9f71-44d9-9fa1-773675553f95', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cadfef7-328b-4d23-889d-4cab94de45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cadfef7-328b-4d23-889d-4cab94de45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8825c2b9-c45a-4e36-9069-0b0599691495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume e85bcba0-9f71-44d9-9fa1-773675553f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85bcba0-9f71-44d9-9fa1-773675553f95', 'volume_size': 1} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:01 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 Aug 28 09:08:01 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:01 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b 1073741824" returned: 0 in 0.677s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:01 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b Aug 28 09:08:01 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:01 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3" returned: 0 in 0.441s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:01 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3 Aug 28 09:08:01 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:01 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b" returned: 0 in 0.322s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520333206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce67f90f-6a26-4577-b733-144ae39cb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:00Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume ce67f90f-6a26-4577-b733-144ae39cb7d8 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f12088-a42c-407e-a3b6-77c09c7c27eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877e14bf-d310-46a4-8399-6ade620e529b', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ca3a07-4158-4b1f-bb05-d06c884c0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:01 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 1073741824 Aug 28 09:08:01 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-877e14bf-d310-46a4-8399-6ade620e529b (877e14bf-d310-46a4-8399-6ade620e529b): created successfully Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ca3a07-4158-4b1f-bb05-d06c884c0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (d8e672e1-3fa6-48ea-904b-6ed42769c57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e0de6b0d-eb36-436d-8448-d8ec4a75be35 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:08:02 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f045cdd0-7678-4650-9c0c-553f59c88cf3" returned: 0 in 0.339s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "cinder-quobyte-f045cdd0-7678-4650-9c0c-553f59c88cf3" released by "delete_volume" :: held 0.867s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Created reservations ['9da48cbc-e316-437a-8b3c-e0300755a9f3', '438c83ba-eebd-4948-a1e4-542edb2e807f', '9433fa92-8dd7-4215-acf9-b81f02afb1c0', '6d748dbd-f8f3-460a-aa29-1e1ba7813703'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:02 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:02 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:02 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 1073741824" returned: 0 in 0.670s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:02 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 Aug 28 09:08:02 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:02 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.391s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Deleted volume successfully. Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cfd5fc55-511c-46bf-a18e-4d117d6a3e4f tempest-ProjectReaderTests-1700221151 None] Lock "cinder-f045cdd0-7678-4650-9c0c-553f59c88cf3-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:02 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8" returned: 0 in 0.340s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca280a-a959-4365-94f5-b6301aa8f2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167158128c4d4b578772f209fab3699d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:07:58Z,use_quota=True,user_id='171f6dc6f34f440294dffac3c5ee22c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Creating volume 5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:03 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f396891d-79b4-4838-908c-7bee67a5b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce67f90f-6a26-4577-b733-144ae39cb7d8', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7122abd5-27a8-4361-abdf-aff4cdce6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:03 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1073741824 Aug 28 09:08:03 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:03 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 (ce67f90f-6a26-4577-b733-144ae39cb7d8): created successfully Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7122abd5-27a8-4361-abdf-aff4cdce6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (6f273050-464f-46b1-bc24-326d95733107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-adf79315-e8f2-44e1-80aa-326825a822a2 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:08:03 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1073741824" returned: 0 in 0.610s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:03 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 Aug 28 09:08:03 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:04 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3" returned: 0 in 0.335s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314073204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613564f5-0f70-4793-af46-4feb041db951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:01Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume 613564f5-0f70-4793-af46-4feb041db951 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:04 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:04 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 1073741824 Aug 28 09:08:04 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Attempting download of af89011b-1960-47c4-ae63-8cd6c49012b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}])) to volume 5aca280a-a959-4365-94f5-b6301aa8f2c3. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[359cdc28-ed86-4be8-9df2-705c8751f34f]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:04 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru Aug 28 09:08:04 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:04 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru" returned: 0 in 0.432s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:04 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 1073741824" returned: 0 in 0.608s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:04 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 Aug 28 09:08:04 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:04 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru Aug 28 09:08:04 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:05 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951" returned: 0 in 0.350s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:05 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.601s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306678766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85bcba0-9f71-44d9-9fa1-773675553f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6925ece8e84848bab876950977918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:01Z,use_quota=True,user_id='5297c61d696b43909319291ba9a8357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Creating volume e85bcba0-9f71-44d9-9fa1-773675553f95 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru" returned: 1 in 0.508s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af89011b-1960-47c4-ae63-8cd6c49012b6_xdlmk6ru' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc4fb3e-ed41-4156-a32d-e21777d0abaf]: (4, 'raw') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:05 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 1073741824 Aug 28 09:08:05 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c035be-1c80-449c-a78e-a64846889dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613564f5-0f70-4793-af46-4feb041db951', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08321e8d-3660-4510-80b4-e907d373ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-613564f5-0f70-4793-af46-4feb041db951 (613564f5-0f70-4793-af46-4feb041db951): created successfully Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08321e8d-3660-4510-80b4-e907d373ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (458e49b4-dbb9-4a5f-abd5-fa7438c1cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d516ca46-e6b3-4310-89a9-fa3051527285 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:08:05 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:08:05 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:05 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:05 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD Aug 28 09:08:05 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:05 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 1073741824" returned: 0 in 0.689s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:05 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 Aug 28 09:08:05 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a42afad7-b079-4693-88cf-91948b2a91e3 tempest-ProjectAdminTests-1299079860 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5886573791504, 'free_capacity_gb': 1774.5886573791504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85762) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 09:08:06 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD" returned: 1 in 0.539s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD' failed. Not Retrying. {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] af89011b-1960-47c4-ae63-8cd6c49012b6 was raw, converting to qcow2 {{(pid=85762) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:08:06 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:06 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 Aug 28 09:08:06 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8825c2b9-c45a-4e36-9069-0b0599691495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85bcba0-9f71-44d9-9fa1-773675553f95', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1690d-c698-4205-bc1e-a95280f83e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Volume volume-e85bcba0-9f71-44d9-9fa1-773675553f95 (e85bcba0-9f71-44d9-9fa1-773675553f95): created successfully Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1690d-c698-4205-bc1e-a95280f83e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Flow 'volume_create_manager' (4deefdfc-61d6-4140-b653-1b02708e989b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-2f7092fd-d739-4ee5-a081-2c13a1ae7f4b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created volume successfully. Aug 28 09:08:06 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3" returned: 0 in 0.607s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af89011b-1960-47c4-ae63-8cd6c49012b6_vyv6kkg3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:08:06 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:08:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:06 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1G Aug 28 09:08:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:07 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-e85bcba0-9f71-44d9-9fa1-773675553f95-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 1G" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Downloaded image af89011b-1960-47c4-ae63-8cd6c49012b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}])) to volume 5aca280a-a959-4365-94f5-b6301aa8f2c3 successfully. {{(pid=85762) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Temporary image af89011b-1960-47c4-ae63-8cd6c49012b6 for user 171f6dc6f34f440294dffac3c5ee22c3 is deleted. {{(pid=85762) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.volume_utils [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Marking volume 5aca280a-a959-4365-94f5-b6301aa8f2c3 as bootable. {{(pid=85762) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-e85bcba0-9f71-44d9-9fa1-773675553f95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Copying metadata from image af89011b-1960-47c4-ae63-8cd6c49012b6 to 5aca280a-a959-4365-94f5-b6301aa8f2c3. {{(pid=85762) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Creating volume glance metadata for volume 5aca280a-a959-4365-94f5-b6301aa8f2c3 backed by image af89011b-1960-47c4-ae63-8cd6c49012b6 with: {'image_id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc90c6f223d45a3c24f0c0fa7b9bf457', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85762) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-e85bcba0-9f71-44d9-9fa1-773675553f95" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-e85bcba0-9f71-44d9-9fa1-773675553f95" acquired by "delete_volume" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d57247-f066-4738-8485-0d592b6b1287]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5f8a48-25f7-4ca0-ba0a-026ae34521b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aca280a-a959-4365-94f5-b6301aa8f2c3', 'volume_size': 1, 'image_id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af89011b-1960-47c4-ae63-8cd6c49012b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc90c6f223d45a3c24f0c0fa7b9bf457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167158128c4d4b578772f209fab3699d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55cd61aa436a0d0beb1090bcc297bbfa6832abcf700791ec6bba8ee39842487a039b0b86da4744253af16baf038c764ab1502385619e9ebf1884cb9d4b243ccc', 'id': 'af89011b-1960-47c4-ae63-8cd6c49012b6', 'created_at': datetime.datetime(2026, 8, 28, 7, 7, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af89011b-1960-47c4-ae63-8cd6c49012b6/file', 'properties': {}}, 'image_service': }' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98843eae-5daf-4b46-ba84-a0ab58f86a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:07 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Volume volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 (5aca280a-a959-4365-94f5-b6301aa8f2c3): created successfully Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98843eae-5daf-4b46-ba84-a0ab58f86a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Flow 'volume_create_manager' (b22e2e27-f0fc-464a-a3c1-e52fc778d6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fe7adfa4-c1f8-456e-8221-7d01fedfd6c3 tempest-VolumeImageDependencyTests-705232867 None] Created volume successfully. Aug 28 09:08:07 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 Aug 28 09:08:07 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:07 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95" returned: 0 in 0.473s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:07 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95 Aug 28 09:08:07 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:08 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-e85bcba0-9f71-44d9-9fa1-773675553f95" returned: 0 in 0.281s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-e85bcba0-9f71-44d9-9fa1-773675553f95" released by "delete_volume" :: held 0.818s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['0324f57f-a20f-4d65-9af7-662630232e92', '471ffd1c-a31b-4cd0-a580-a05254604289', '3773a590-3b8a-4870-b132-7f3874a403ef', 'e4be4fcf-9d96-4f79-a1a2-5b078e0787e9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:08 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:08 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-613564f5-0f70-4793-af46-4feb041db951-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-613564f5-0f70-4793-af46-4feb041db951-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-613564f5-0f70-4793-af46-4feb041db951" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-613564f5-0f70-4793-af46-4feb041db951" acquired by "delete_volume" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff3f58-0c38-4bc5-a0f1-7f6cc7bd575c]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Acquiring lock "cinder-5aca280a-a959-4365-94f5-b6301aa8f2c3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "cinder-5aca280a-a959-4365-94f5-b6301aa8f2c3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Acquiring lock "cinder-quobyte-5aca280a-a959-4365-94f5-b6301aa8f2c3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:08 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "cinder-quobyte-5aca280a-a959-4365-94f5-b6301aa8f2c3" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.520s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:08 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:08 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 Aug 28 09:08:08 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a4dba500-ec9c-4459-8a5b-86533c31cb3a tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-e85bcba0-9f71-44d9-9fa1-773675553f95-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d0b7d2-eda7-4c28-a684-a33b1fd08d2e]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:09 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 Aug 28 09:08:09 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:09 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951" returned: 0 in 0.648s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:09 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951 Aug 28 09:08:09 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:09 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3" returned: 0 in 0.562s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:09 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3 Aug 28 09:08:09 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:09 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-613564f5-0f70-4793-af46-4feb041db951" returned: 0 in 0.295s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-613564f5-0f70-4793-af46-4feb041db951" released by "delete_volume" :: held 1.027s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['9deea3b9-d414-473a-ac91-47ff89c6b459', '9002baca-5abe-462e-acf6-ba724086f168', 'fd455699-73c9-4fe6-a850-6787148ab9be', 'cf47ac55-bff5-4281-9027-0e6a36d04139'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:09 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5aca280a-a959-4365-94f5-b6301aa8f2c3" returned: 0 in 0.383s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "cinder-quobyte-5aca280a-a959-4365-94f5-b6301aa8f2c3" released by "delete_volume" :: held 1.069s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:09 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:09 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Created reservations ['bbdd2edd-1704-4f9d-b5ae-c0b977388de1', '6a17dc90-9aff-4272-88d5-54f6207466b1', 'c101e9c2-022b-4f24-ac61-b82557afecbc', '07fb0b22-0dd5-4a78-9aab-07ee468bcdad'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:10 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.329s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:10 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:10 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9169a465-ae91-48eb-80b5-37540565d83b tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-613564f5-0f70-4793-af46-4feb041db951-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:10 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.306s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Deleted volume successfully. Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6e519fe0-a280-4e52-b16d-f34b1dc20354 tempest-VolumeImageDependencyTests-705232867 None] Lock "cinder-5aca280a-a959-4365-94f5-b6301aa8f2c3-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-ce67f90f-6a26-4577-b733-144ae39cb7d8-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-ce67f90f-6a26-4577-b733-144ae39cb7d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-ce67f90f-6a26-4577-b733-144ae39cb7d8" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-ce67f90f-6a26-4577-b733-144ae39cb7d8" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976ae2e-1d19-48e4-8cb7-732ebf6ea2a1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:11 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 Aug 28 09:08:11 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:11 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8" returned: 0 in 0.508s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:11 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8 Aug 28 09:08:11 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:11 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-ce67f90f-6a26-4577-b733-144ae39cb7d8" returned: 0 in 0.366s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-ce67f90f-6a26-4577-b733-144ae39cb7d8" released by "delete_volume" :: held 0.941s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:11 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['b5d0c171-2b7d-4394-861e-6bb55e1250a3', '1289fe2f-d827-4bce-b27c-0149eabc4268', '20bb690c-8737-4ea5-8683-332138ba8b07', '3a61e1ad-d34e-4b2a-8e40-c5a44afbf950'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:12 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:12 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-877e14bf-d310-46a4-8399-6ade620e529b-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-877e14bf-d310-46a4-8399-6ade620e529b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-877e14bf-d310-46a4-8399-6ade620e529b" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-877e14bf-d310-46a4-8399-6ade620e529b" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2767220a-f09c-461e-ba0f-823c0dd4b766]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:12 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.500s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:12 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b Aug 28 09:08:12 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-983df213-46a9-40a6-a721-d42ef5a23e27 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-ce67f90f-6a26-4577-b733-144ae39cb7d8-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:13 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b" returned: 0 in 0.629s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:13 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b Aug 28 09:08:13 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:13 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-877e14bf-d310-46a4-8399-6ade620e529b" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-877e14bf-d310-46a4-8399-6ade620e529b" released by "delete_volume" :: held 1.046s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['2a85e42d-0c2d-4c17-af11-66c8d1e4d3e1', '81ff3239-488a-4821-970f-7b8967397a0a', 'c71b00bf-340c-4f16-99c0-a56878b46dad', '4c145e99-5cdd-45cc-8645-853272f77ea7'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:13 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:13 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:13 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6ed53d3d-9e96-4b6b-b5d6-182cba38c476 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-877e14bf-d310-46a4-8399-6ade620e529b-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-329c6925-2794-4deb-8c22-6bd08d7c9163-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-329c6925-2794-4deb-8c22-6bd08d7c9163-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-329c6925-2794-4deb-8c22-6bd08d7c9163" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-329c6925-2794-4deb-8c22-6bd08d7c9163" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a47e6f0-67ca-4f32-aaad-4413585748f4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:14 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 Aug 28 09:08:14 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:15 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163" returned: 0 in 0.658s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:15 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163 Aug 28 09:08:15 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:15 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-329c6925-2794-4deb-8c22-6bd08d7c9163" returned: 0 in 0.497s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-329c6925-2794-4deb-8c22-6bd08d7c9163" released by "delete_volume" :: held 1.225s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=208,cinder:UPDATE=274,cinder:DELETE=29,cinder:INSERT=68 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:08:15 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=293,cinder:SELECT=206,cinder:INSERT=83,cinder:DELETE=22 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['0cdcd78d-b60d-4f35-8e88-6da34c205852', 'ba83b24e-2523-4c60-80c0-8b4c1e720eca', 'b3434181-0df3-4684-81c2-02eb1b1d5aa4', 'edb66b9f-5c88-41b5-bd8a-81fb1c005a82'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:16 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:16 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:16 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.334s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f720fe3c-4d2a-421d-8489-5a7e4624b4a9 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-329c6925-2794-4deb-8c22-6bd08d7c9163-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-d8ade941-7e1e-45be-8e8a-65aaf01eda09-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-d8ade941-7e1e-45be-8e8a-65aaf01eda09-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "cinder-quobyte-d8ade941-7e1e-45be-8e8a-65aaf01eda09" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-d8ade941-7e1e-45be-8e8a-65aaf01eda09" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd57fb2-4267-40e0-94a7-e4962c781e57]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:17 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 Aug 28 09:08:17 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:17 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09" returned: 0 in 0.438s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:17 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09 Aug 28 09:08:17 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:17 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d8ade941-7e1e-45be-8e8a-65aaf01eda09" returned: 0 in 0.420s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-quobyte-d8ade941-7e1e-45be-8e8a-65aaf01eda09" released by "delete_volume" :: held 0.922s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:17 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Created reservations ['afe5fe15-f6cd-4a2b-953e-beeacc402969', '2b5688e0-2956-4ee0-8092-34ee488e12e8', 'acbca1eb-b5be-46d6-9c68-88c7dffdba6a', '01bca2d3-0262-4112-913a-fc2d07c1e94c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:18 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:18 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:18 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.425s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:18 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Deleted volume successfully. Aug 28 09:08:18 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-91329f83-afc9-4c00-80d1-d969ff4bbcb3 tempest-CreateVolumesFromSourceVolumeTest-770221450 None] Lock "cinder-d8ade941-7e1e-45be-8e8a-65aaf01eda09-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (0fc8cfbb-3e87-4ed6-ab09-7dba745e371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe5465-5e6d-448f-bd3d-f0a6dc867950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe5465-5e6d-448f-bd3d-f0a6dc867950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735997750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a67079-b01d-44fa-8dc4-15cbe2d5c9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:19Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188e1924-1288-49c9-a93c-14efb0a870cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188e1924-1288-49c9-a93c-14efb0a870cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb9eec-1dd8-4458-8537-c419e7a9be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb9eec-1dd8-4458-8537-c419e7a9be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a67079-b01d-44fa-8dc4-15cbe2d5c9d3', 'volume_name': 'volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aacee27-b235-4432-8072-73b4f1d16568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aacee27-b235-4432-8072-73b4f1d16568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2893692-7f47-4176-bc0c-f3cfae03c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Volume 35a67079-b01d-44fa-8dc4-15cbe2d5c9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3', 'volume_size': 1} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735997750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a67079-b01d-44fa-8dc4-15cbe2d5c9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:19Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Creating volume 35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:19 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:19 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 1073741824 Aug 28 09:08:19 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:20 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 1073741824" returned: 0 in 0.603s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:20 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 Aug 28 09:08:20 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:20 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2893692-7f47-4176-bc0c-f3cfae03c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7561cf50-53c7-4f2f-914e-812f56ca384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:20 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Volume volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 (35a67079-b01d-44fa-8dc4-15cbe2d5c9d3): created successfully Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7561cf50-53c7-4f2f-914e-812f56ca384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:20 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (0fc8cfbb-3e87-4ed6-ab09-7dba745e371c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:20 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7e0a7973-56a2-43fe-b1e7-914b9cdde6d4 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 17cca17a-81e1-4f76-9f0f-c99a1e73b81d of volume 35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0888da92-4511-4b67-9deb-d2a556a970c1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:22 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 Aug 28 09:08:22 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:22 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" returned: 0 in 0.616s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:22 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d 1G Aug 28 09:08:22 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:23 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d 1G" returned: 0 in 0.688s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:23 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d Aug 28 09:08:23 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:23 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:23 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d is being set with open permissions: ugo+rw Aug 28 09:08:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:23 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d Aug 28 09:08:23 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:24 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d" returned: 0 in 0.501s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:24 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info Aug 28 09:08:24 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:24 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info" returned: 0 in 0.404s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:24 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info is being set with open permissions: ugo+rw Aug 28 09:08:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:24 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info Aug 28 09:08:24 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:25 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.info" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-52ee31a6-7b20-40a5-afa0-7302678b376a tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-17cca17a-81e1-4f76-9f0f-c99a1e73b81d-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-17cca17a-81e1-4f76-9f0f-c99a1e73b81d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-17cca17a-81e1-4f76-9f0f-c99a1e73b81d" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-17cca17a-81e1-4f76-9f0f-c99a1e73b81d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 17cca17a-81e1-4f76-9f0f-c99a1e73b81d of volume 35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b26116-18a6-4fe6-bb84-a107cdf62fe3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:26 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d Aug 28 09:08:26 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:27 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d" returned: 0 in 0.542s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da47f7-df03-46a7-99d3-0a816ad06531]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:27 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 Aug 28 09:08:27 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:27 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" returned: 0 in 0.509s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:27 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d Aug 28 09:08:27 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:28 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d" returned: 0 in 0.546s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:28 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d Aug 28 09:08:28 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:28 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3.17cca17a-81e1-4f76-9f0f-c99a1e73b81d" returned: 0 in 0.298s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-17cca17a-81e1-4f76-9f0f-c99a1e73b81d" released by "_delete_snapshot" :: held 2.105s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" released by "delete_snapshot" :: held 2.144s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Created reservations ['864cfea2-fed0-420e-8633-07b52e48677d', '451c17f3-fe87-40d9-8be4-83e3a5dfb982', '16a041a2-f8a3-4e4f-a45d-28f0c8a33a81', 'eb1ef8d4-1277-4a82-8426-0514c3683c01'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:28 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:08:28 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-fe7c3527-9f82-4857-8911-afeff93a0f08 tempest-ProjectMemberTests-979591955 None] Lock "cinder-17cca17a-81e1-4f76-9f0f-c99a1e73b81d-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" acquired by "delete_volume" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6172928-e1dd-4090-a59d-0d41cdbc93e0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:30 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 Aug 28 09:08:30 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:30 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" returned: 0 in 0.548s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:30 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3 Aug 28 09:08:30 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:30 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" returned: 0 in 0.311s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3" released by "delete_volume" :: held 0.948s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Created reservations ['cf97ce22-0cea-4213-b1db-96362f27c9fe', '001c09f5-2d57-49ed-801a-955e7b8c2825', 'e41035b2-6bb2-4775-b080-c0b901115a97', 'b2ff2de0-0c98-4eb2-a06a-88bd377d595e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:30 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:30 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:31 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.312s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:31 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:31 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:08:31 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1cf3cd98-03a7-4068-8fad-4661c2951fa1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-35a67079-b01d-44fa-8dc4-15cbe2d5c9d3-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (d16e553b-815c-4f25-a3a1-5838b3610cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c1ef29-f654-4e98-80d3-72f5a4da241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c1ef29-f654-4e98-80d3-72f5a4da241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207601567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1108da5c-c69e-4c70-ae00-046b861e42d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:32Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46348327-1d4c-4e70-9d56-44a194fb2602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46348327-1d4c-4e70-9d56-44a194fb2602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1f2f9c-bbd4-45c6-b17f-d0b1a9ba9943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1f2f9c-bbd4-45c6-b17f-d0b1a9ba9943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1108da5c-c69e-4c70-ae00-046b861e42d9', 'volume_name': 'volume-1108da5c-c69e-4c70-ae00-046b861e42d9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57656cb-8359-4af3-a596-95948af8a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57656cb-8359-4af3-a596-95948af8a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125bb929-0857-4dac-9ebf-804585b77b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Volume 1108da5c-c69e-4c70-ae00-046b861e42d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1108da5c-c69e-4c70-ae00-046b861e42d9', 'volume_size': 1} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207601567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1108da5c-c69e-4c70-ae00-046b861e42d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:32Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Creating volume 1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:32 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:32 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 1073741824 Aug 28 09:08:32 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (f7cf628c-6060-47c0-ae87-bb868ff0e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d40671-f1cf-4300-8b27-cedcabd6c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d40671-f1cf-4300-8b27-cedcabd6c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109563881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89216a2-0f84-4c70-8f1c-1ab210af4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:33Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0ce597-5b3e-4777-8044-0ff3b0480b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0ce597-5b3e-4777-8044-0ff3b0480b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9717407-4740-4bb9-8556-7b32a9f59287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9717407-4740-4bb9-8556-7b32a9f59287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89216a2-0f84-4c70-8f1c-1ab210af4666', 'volume_name': 'volume-c89216a2-0f84-4c70-8f1c-1ab210af4666', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45506968-e25b-45cc-a6d1-5c51fbcea2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45506968-e25b-45cc-a6d1-5c51fbcea2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a00446-d53b-4551-a36e-e35de9bde630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:32 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Volume c89216a2-0f84-4c70-8f1c-1ab210af4666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89216a2-0f84-4c70-8f1c-1ab210af4666', 'volume_size': 1} Aug 28 09:08:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:33 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 1073741824" returned: 0 in 0.603s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:33 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 Aug 28 09:08:33 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:33 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9" returned: 0 in 0.272s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109563881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89216a2-0f84-4c70-8f1c-1ab210af4666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:33Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Creating volume c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:33 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125bb929-0857-4dac-9ebf-804585b77b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1108da5c-c69e-4c70-ae00-046b861e42d9', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab664034-6d8a-4bee-80b1-4f80a882e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:33 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 1073741824 Aug 28 09:08:33 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:33 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Volume volume-1108da5c-c69e-4c70-ae00-046b861e42d9 (1108da5c-c69e-4c70-ae00-046b861e42d9): created successfully Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab664034-6d8a-4bee-80b1-4f80a882e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:33 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (d16e553b-815c-4f25-a3a1-5838b3610cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:33 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-545ca5e0-72c8-497e-9782-c71dc7b8c951 tempest-ProjectReaderTests-171513888 None] Created volume successfully. Aug 28 09:08:34 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 1073741824" returned: 0 in 0.523s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:34 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 Aug 28 09:08:34 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:34 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666" returned: 0 in 0.278s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a00446-d53b-4551-a36e-e35de9bde630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89216a2-0f84-4c70-8f1c-1ab210af4666', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f989056f-a1d8-4438-9162-c1881f77d33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:34 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Volume volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 (c89216a2-0f84-4c70-8f1c-1ab210af4666): created successfully Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f989056f-a1d8-4438-9162-c1881f77d33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (f7cf628c-6060-47c0-ae87-bb868ff0e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9471580d-1ac8-4e8f-b442-6501a24356cb tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Creating offline snapshot 31940bf7-1688-486f-9dde-28b3162bf2af of volume 1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcbb2e7-5a7f-4b2c-8dcb-15aa8166d6ae]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:34 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 Aug 28 09:08:34 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:35 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9" returned: 0 in 0.502s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:35 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af 1G Aug 28 09:08:35 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:35 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af 1G" returned: 0 in 0.493s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1108da5c-c69e-4c70-ae00-046b861e42d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:35 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1108da5c-c69e-4c70-ae00-046b861e42d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af Aug 28 09:08:35 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:36 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1108da5c-c69e-4c70-ae00-046b861e42d9 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af" returned: 0 in 0.318s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:36 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af is being set with open permissions: ugo+rw Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:36 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af Aug 28 09:08:36 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:36 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af" returned: 0 in 0.252s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:36 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info Aug 28 09:08:36 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:36 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:36 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info is being set with open permissions: ugo+rw Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:36 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info Aug 28 09:08:36 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:36 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.info" returned: 0 in 0.275s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.824s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 88edc46d-1196-4766-8b44-4a8c8c659167 of volume c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ac954d39-ab14-4974-8d5d-a59e1dd84e59 tempest-ProjectReaderTests-171513888 None] Create snapshot completed successfully Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df76918-2a1e-4806-962b-f32c3e904e3d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:37 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 Aug 28 09:08:37 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:37 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:37 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 1G Aug 28 09:08:37 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:37 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 1G" returned: 0 in 0.447s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:37 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 Aug 28 09:08:37 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-31940bf7-1688-486f-9dde-28b3162bf2af-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-31940bf7-1688-486f-9dde-28b3162bf2af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:38 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167" returned: 0 in 0.335s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:38 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 is being set with open permissions: ugo+rw Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" acquired by "delete_snapshot" :: waited 0.050s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-31940bf7-1688-486f-9dde-28b3162bf2af" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:38 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 Aug 28 09:08:38 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-31940bf7-1688-486f-9dde-28b3162bf2af" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Deleting offline snapshot 31940bf7-1688-486f-9dde-28b3162bf2af of volume 1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] snapshot_file for this snap is: volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[27894544-3ba0-444a-aeea-e6c8c0c91ad1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:38 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af Aug 28 09:08:38 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:38 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167" returned: 0 in 0.276s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:38 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info Aug 28 09:08:38 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:38 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af" returned: 0 in 0.431s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1108da5c-c69e-4c70-ae00-046b861e42d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[86550ed7-3a20-4488-a65a-3ba590f70a91]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:38 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info" returned: 0 in 0.360s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:38 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info is being set with open permissions: ugo+rw Aug 28 09:08:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:38 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info Aug 28 09:08:38 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:38 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 Aug 28 09:08:38 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:39 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.info" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:39 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:39 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af Aug 28 09:08:39 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:39 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6b0e36e6-ae6e-4a75-8236-785e07c9a43c tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-88edc46d-1196-4766-8b44-4a8c8c659167-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-88edc46d-1196-4766-8b44-4a8c8c659167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-88edc46d-1196-4766-8b44-4a8c8c659167" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-88edc46d-1196-4766-8b44-4a8c8c659167" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 88edc46d-1196-4766-8b44-4a8c8c659167 of volume c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df1de9-594e-4ac1-a4ca-10762c689ef6]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:39 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 Aug 28 09:08:39 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:39 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:39 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af Aug 28 09:08:39 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:39 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167" returned: 0 in 0.458s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:39 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c89216a2-0f84-4c70-8f1c-1ab210af4666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:39 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9.31940bf7-1688-486f-9dde-28b3162bf2af" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cd23c-cba5-41c5-aa10-245fdd650a03]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-31940bf7-1688-486f-9dde-28b3162bf2af" released by "_delete_snapshot" :: held 1.758s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" released by "delete_snapshot" :: held 1.803s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Created reservations ['2943598a-1655-48c4-b609-b3228e95b03d', 'fe43523e-4ccd-4370-9553-7a80c4ac9239', '02262e6c-949e-4c00-8bec-8f6534001869', 'e4e19a0d-51e4-4ce4-8d37-4c2d1ea2b099'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:40 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 Aug 28 09:08:40 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Flow 'volume_create_manager' (c445e7a1-ce3b-4fae-a291-e9fb5a2455e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd22002-2ace-4dc0-97aa-5f5251c2b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd22002-2ace-4dc0-97aa-5f5251c2b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-83943652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac34670-10d4-4c21-b5b5-fced53c6ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4dee8860094ac18a3824afb9721981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:40Z,use_quota=True,user_id='f84af43eb890433e8bada766b1fa206c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e17943f-d8e8-439c-927a-1d4ac794f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e17943f-d8e8-439c-927a-1d4ac794f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8a34d-62da-435a-8445-1e04b5e9f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8a34d-62da-435a-8445-1e04b5e9f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac34670-10d4-4c21-b5b5-fced53c6ae07', 'volume_name': 'volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3ecfd-4ba0-49fd-bf26-6da3135b938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3ecfd-4ba0-49fd-bf26-6da3135b938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c11a18-3fcc-49bf-b12e-9f2a2741d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:40 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Volume 5ac34670-10d4-4c21-b5b5-fced53c6ae07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07', 'volume_size': 1} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-83943652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac34670-10d4-4c21-b5b5-fced53c6ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4dee8860094ac18a3824afb9721981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:40Z,use_quota=True,user_id='f84af43eb890433e8bada766b1fa206c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Creating volume 5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:40 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 1073741824 Aug 28 09:08:40 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Delete snapshot completed successfully. Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9577a5f7-5cf1-4d04-b0b5-a4f30afbe7a1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-31940bf7-1688-486f-9dde-28b3162bf2af-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-1108da5c-c69e-4c70-ae00-046b861e42d9-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:40 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:40 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-1108da5c-c69e-4c70-ae00-046b861e42d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:40 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666" returned: 0 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" acquired by "delete_volume" :: waited 0.043s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:40 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 Aug 28 09:08:40 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa7e5e-b2d7-42cb-80d7-c36794320575]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.297s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:08:40 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 Aug 28 09:08:40 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 1073741824" returned: 0 in 0.558s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167" returned: 0 in 0.411s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:40 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:40 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:40 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167 Aug 28 09:08:40 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:41 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9" returned: 0 in 0.473s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:41 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9 Aug 28 09:08:41 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:41 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.320s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:41 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666.88edc46d-1196-4766-8b44-4a8c8c659167" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c11a18-3fcc-49bf-b12e-9f2a2741d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56e7896-0846-4ddd-8f62-1795f1f520dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:41 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Volume volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 (5ac34670-10d4-4c21-b5b5-fced53c6ae07): created successfully Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56e7896-0846-4ddd-8f62-1795f1f520dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Flow 'volume_create_manager' (c445e7a1-ce3b-4fae-a291-e9fb5a2455e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-88edc46d-1196-4766-8b44-4a8c8c659167" released by "_delete_snapshot" :: held 1.812s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" released by "delete_snapshot" :: held 1.845s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a2414dd6-dea3-4367-9774-cad429187227 tempest-SnapshotDependencyTests-894715995 None] Created volume successfully. Aug 28 09:08:41 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-1108da5c-c69e-4c70-ae00-046b861e42d9" returned: 0 in 0.291s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-1108da5c-c69e-4c70-ae00-046b861e42d9" released by "delete_volume" :: held 0.850s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Created reservations ['79f55c2e-29eb-4418-8d55-9734914aaed2', '17e75571-9aa9-4ab8-a9be-c5863c1fd154', '6bc24b43-829d-4dfc-a52f-91d8d48dc7b9', '0ae8bfbc-c43c-4404-910d-c3cdadf11402'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-eb9bb098-2b73-4a5a-92a4-20b261a1a4b4 tempest-ProjectMemberTests-979591955 None] Lock "cinder-88edc46d-1196-4766-8b44-4a8c8c659167-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Created reservations ['c6b59d71-cff7-4819-8a0e-b56538d8d7d7', '822de269-c698-4421-8608-7eaec1e2c205', '95ac2117-ab96-4bdd-9375-a77b860200a3', '2da59e58-f604-4910-b53d-31eaf80af160'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:41 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:41 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-c89216a2-0f84-4c70-8f1c-1ab210af4666-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c89216a2-0f84-4c70-8f1c-1ab210af4666-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8652b33-c446-4e17-8dea-ec4be2878424]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:41 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.318s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Deleted volume successfully. Aug 28 09:08:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-d0bc5ba8-8563-47d3-98de-3683f3e3b1f4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-1108da5c-c69e-4c70-ae00-046b861e42d9-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:41 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 Aug 28 09:08:41 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (bfec4f4b-8192-4fed-851e-b25d23c53672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170660a2-a99d-4659-bc6e-3cf5edca26dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170660a2-a99d-4659-bc6e-3cf5edca26dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402676174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48e5f4b-099a-421a-8b88-8a7c774ed010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:42Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a1932c-6ceb-4701-ad11-014dc1ad931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a1932c-6ceb-4701-ad11-014dc1ad931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204bd5d3-514f-434e-8c40-cbcc488aff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204bd5d3-514f-434e-8c40-cbcc488aff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48e5f4b-099a-421a-8b88-8a7c774ed010', 'volume_name': 'volume-b48e5f4b-099a-421a-8b88-8a7c774ed010', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dfd77f-e88b-4827-88f0-c86630abe49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dfd77f-e88b-4827-88f0-c86630abe49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e2f904-2541-48c3-bd78-c1f4e247a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Volume b48e5f4b-099a-421a-8b88-8a7c774ed010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48e5f4b-099a-421a-8b88-8a7c774ed010', 'volume_size': 1} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402676174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48e5f4b-099a-421a-8b88-8a7c774ed010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:42Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Creating volume b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:42 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:42 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666" returned: 0 in 0.490s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:42 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 1073741824 Aug 28 09:08:42 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:42 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666 Aug 28 09:08:42 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:42 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c89216a2-0f84-4c70-8f1c-1ab210af4666" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c89216a2-0f84-4c70-8f1c-1ab210af4666" released by "delete_volume" :: held 0.854s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Created reservations ['21a656bc-b4f7-49ec-9082-55c030954ff7', '01b6ec77-fa99-4f5e-a102-38bb85520ea6', '1561a89d-ec99-4a36-91ee-e8e5a94f0f03', '05270fff-54e7-44c1-9026-9f2befe2a8e1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:42 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:42 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:42 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 1073741824" returned: 0 in 0.522s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:42 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 Aug 28 09:08:42 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:43 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-bc9a42b5-5639-438b-933e-41d332f5cde8 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c89216a2-0f84-4c70-8f1c-1ab210af4666-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:43 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.589s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e2f904-2541-48c3-bd78-c1f4e247a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48e5f4b-099a-421a-8b88-8a7c774ed010', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a7ef34-b044-4eac-afe9-8d6a11b9b40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Creating offline snapshot 1f6c883d-5f35-42df-9ad5-9653aeebfa23 of volume 5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:43 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Volume volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 (b48e5f4b-099a-421a-8b88-8a7c774ed010): created successfully Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a7ef34-b044-4eac-afe9-8d6a11b9b40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (bfec4f4b-8192-4fed-851e-b25d23c53672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edbff2-db01-4aba-aeea-9aa4debfabbd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:43 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-89081cd3-f04f-45f3-97c4-c994d3433394 tempest-ProjectReaderTests-171513888 None] Created volume successfully. Aug 28 09:08:43 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:43 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (4e98f49c-8f8b-4495-9052-51ec47b809cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f81863-8633-48a9-917e-163463ecfa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f81863-8633-48a9-917e-163463ecfa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428576166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15794cd8-4403-4941-ba53-3a01cb7e6164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:43Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c8815-ecd2-4009-b528-acc84bf074b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c8815-ecd2-4009-b528-acc84bf074b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b136a6-5e39-4b73-81e3-e59496b0ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b136a6-5e39-4b73-81e3-e59496b0ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15794cd8-4403-4941-ba53-3a01cb7e6164', 'volume_name': 'volume-15794cd8-4403-4941-ba53-3a01cb7e6164', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5115a668-391e-49e2-ba7d-11374b161ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5115a668-391e-49e2-ba7d-11374b161ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d192ee2a-98a4-4fd0-adf2-0465aaec2429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:43 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Volume 15794cd8-4403-4941-ba53-3a01cb7e6164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15794cd8-4403-4941-ba53-3a01cb7e6164', 'volume_size': 1} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:43 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.408s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:43 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:43 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 1G Aug 28 09:08:43 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:44 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 1G" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:44 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:44 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:44 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.336s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:44 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 is being set with open permissions: ugo+rw Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:44 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:44 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:44 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:44 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info Aug 28 09:08:44 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:44 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info" returned: 0 in 0.250s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:44 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info is being set with open permissions: ugo+rw Aug 28 09:08:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:44 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info Aug 28 09:08:44 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:45 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.info" returned: 0 in 0.272s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428576166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15794cd8-4403-4941-ba53-3a01cb7e6164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:43Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Creating volume 15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:45 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:45 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 1073741824 Aug 28 09:08:45 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:45 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-360e2288-140c-4499-b928-148368d6b5ea tempest-SnapshotDependencyTests-894715995 None] Create snapshot completed successfully Aug 28 09:08:45 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 1073741824" returned: 0 in 0.455s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:45 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 Aug 28 09:08:45 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:45 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164" returned: 0 in 0.274s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.568s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d192ee2a-98a4-4fd0-adf2-0465aaec2429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15794cd8-4403-4941-ba53-3a01cb7e6164', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7defcc-8618-4a73-9aef-2afcffcbb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Creating offline snapshot 979ab0c6-9f8c-4136-a8e1-ced40b58e675 of volume b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Volume volume-15794cd8-4403-4941-ba53-3a01cb7e6164 (15794cd8-4403-4941-ba53-3a01cb7e6164): created successfully Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7defcc-8618-4a73-9aef-2afcffcbb43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (4e98f49c-8f8b-4495-9052-51ec47b809cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaaad4e-7bce-4ee5-9750-8b409c6128be]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-75117233-37bb-46a2-a42a-9c067b22e416 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:08:46 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 Aug 28 09:08:46 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Flow 'volume_create_manager' (7e39c2b9-4b31-4868-9ddb-ce5e5f025e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07fa63c-971d-4ce0-9002-7bec37c4df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07fa63c-971d-4ce0-9002-7bec37c4df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257bd7be-5a65-4371-a8f9-35babb3fda18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4dee8860094ac18a3824afb9721981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f6c883d-5f35-42df-9ad5-9653aeebfa23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:46Z,use_quota=True,user_id='f84af43eb890433e8bada766b1fa206c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6857ec81-2f7a-4d08-9ab2-7bb1e27c8db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6857ec81-2f7a-4d08-9ab2-7bb1e27c8db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617cf637-be20-42f8-b289-41676eb41ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617cf637-be20-42f8-b289-41676eb41ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '257bd7be-5a65-4371-a8f9-35babb3fda18', 'volume_name': 'volume-257bd7be-5a65-4371-a8f9-35babb3fda18', 'volume_size': 1, 'snapshot_id': '1f6c883d-5f35-42df-9ad5-9653aeebfa23'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeeae25-08d5-4725-8114-698735e5c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeeae25-08d5-4725-8114-698735e5c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea8e32-feda-415d-83fb-3b4dadd13182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:46 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Volume 257bd7be-5a65-4371-a8f9-35babb3fda18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-257bd7be-5a65-4371-a8f9-35babb3fda18', 'volume_size': 1, 'snapshot_id': '1f6c883d-5f35-42df-9ad5-9653aeebfa23'} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:46 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010" returned: 0 in 0.429s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:46 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 1G Aug 28 09:08:46 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:46 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 1G" returned: 0 in 0.450s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:46 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 Aug 28 09:08:46 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:47 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675" returned: 0 in 0.325s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:47 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 is being set with open permissions: ugo+rw Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:47 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 Aug 28 09:08:47 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:47 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675" returned: 0 in 0.261s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:47 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info Aug 28 09:08:47 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:47 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info" returned: 0 in 0.257s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:47 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info is being set with open permissions: ugo+rw Aug 28 09:08:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:47 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info Aug 28 09:08:47 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:48 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.info" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.640s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23-257bd7be-5a65-4371-a8f9-35babb3fda18" by "_create_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23-257bd7be-5a65-4371-a8f9-35babb3fda18" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Creating volume 257bd7be-5a65-4371-a8f9-35babb3fda18 from snapshot 1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" by "_copy_volume_from_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:48 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-48c361da-c500-41f4-90ec-5a4443e780a2 tempest-ProjectReaderTests-171513888 None] Create snapshot completed successfully Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] snapshot: 1f6c883d-5f35-42df-9ad5-9653aeebfa23, volume: 257bd7be-5a65-4371-a8f9-35babb3fda18, {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dfc168-b11a-42a4-a93a-d4e3c1741ddc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:48 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:48 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:48 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.388s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[360a8d40-37eb-4ee5-ae02-4dc950f55430]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-979ab0c6-9f8c-4136-a8e1-ced40b58e675-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-979ab0c6-9f8c-4136-a8e1-ced40b58e675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-979ab0c6-9f8c-4136-a8e1-ced40b58e675" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-979ab0c6-9f8c-4136-a8e1-ced40b58e675" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Deleting offline snapshot 979ab0c6-9f8c-4136-a8e1-ced40b58e675 of volume b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] snapshot_file for this snap is: volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1231531-1b54-4002-9316-fd03c68d28f5]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:48 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:48 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:48 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 Aug 28 09:08:48 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:49 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.422s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Creating direct copy from snapshot {{(pid=85762) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG cinder.utils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Path /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 not found in is_blk_device check {{(pid=85762) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:49 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 Aug 28 09:08:49 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:49 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675" returned: 0 in 0.401s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48e5f4b-099a-421a-8b88-8a7c774ed010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c84367-3248-4cfe-a107-4dcfa01836e7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:49 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 Aug 28 09:08:49 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:49 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010" returned: 0 in 0.450s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:49 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 Aug 28 09:08:49 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:50 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675" returned: 0 in 0.785s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:50 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675 Aug 28 09:08:50 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:51 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:51 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010.979ab0c6-9f8c-4136-a8e1-ced40b58e675" returned: 0 in 0.635s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-979ab0c6-9f8c-4136-a8e1-ced40b58e675" released by "_delete_snapshot" :: held 2.404s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" released by "delete_snapshot" :: held 2.436s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:51 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Created reservations ['e9c33298-132f-43eb-a28b-cd18655236e0', 'fe4f8234-1f00-4632-8850-e7ffc08db7fd', 'edf4c9cc-005b-443d-981f-3dae99480b52', '561d0515-8f72-48dc-a62a-bbe6d05ce705'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:51 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Delete snapshot completed successfully. Aug 28 09:08:51 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9852297-daa7-4439-9920-211dd92bf47e tempest-ProjectReaderTests-171513888 None] Lock "cinder-979ab0c6-9f8c-4136-a8e1-ced40b58e675-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-b48e5f4b-099a-421a-8b88-8a7c774ed010-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-b48e5f4b-099a-421a-8b88-8a7c774ed010-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" acquired by "delete_volume" :: waited 0.039s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bea65a-c531-419d-9f1f-ac2c6fbc4533]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:52 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:52 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 Aug 28 09:08:52 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:53 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010" returned: 0 in 0.771s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:53 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010 Aug 28 09:08:53 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:53 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b48e5f4b-099a-421a-8b88-8a7c774ed010" returned: 0 in 0.592s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-b48e5f4b-099a-421a-8b88-8a7c774ed010" released by "delete_volume" :: held 1.449s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:53 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18" returned: 0 in 4.718s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG cinder.image.image_utils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Image conversion details: src /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 {{(pid=85762) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:08:53 devstack cinder-volume[85762]: INFO cinder.image.image_utils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Converted 1024.00 MB image at 216.96 MB/s Aug 28 09:08:53 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 is being set with open permissions: ugo+rw Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:53 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 Aug 28 09:08:53 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Created reservations ['50d7a4bb-9d7c-4893-9347-d75e03acf69e', '0343b5c9-7ba5-4814-aaa4-8d19a8a2e656', '050f3468-490b-47d6-a22d-44aa2b45c03a', '8f4ce075-6c28-4ce3-819d-04edb415e81c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:53 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:53 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:53 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:54 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" released by "_copy_volume_from_snapshot" :: held 5.871s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23-257bd7be-5a65-4371-a8f9-35babb3fda18" released by "_create_volume_from_snapshot" :: held 5.938s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.962s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.312s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Creating offline snapshot f16b98d9-d3f2-4f4b-9846-268cb14850e6 of volume 15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ea8e32-feda-415d-83fb-3b4dadd13182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257bd7be-5a65-4371-a8f9-35babb3fda18', 'volume_size': 1, 'snapshot_id': '1f6c883d-5f35-42df-9ad5-9653aeebfa23'}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d39a22-8704-468a-9e23-88f3f0de7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad484d-2cde-43d5-a82e-7705fb85fd3b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:54 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Volume volume-257bd7be-5a65-4371-a8f9-35babb3fda18 (257bd7be-5a65-4371-a8f9-35babb3fda18): created successfully Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d39a22-8704-468a-9e23-88f3f0de7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Flow 'volume_create_manager' (7e39c2b9-4b31-4868-9ddb-ce5e5f025e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:54 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.286s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-617bb6db-e207-42b7-9b72-0bc8a9f62f0e tempest-SnapshotDependencyTests-894715995 None] Created volume successfully. Aug 28 09:08:54 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Deleted volume successfully. Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-71a061c5-bc44-4ea4-8193-995b7b114de4 tempest-ProjectReaderTests-171513888 None] Lock "cinder-b48e5f4b-099a-421a-8b88-8a7c774ed010-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:54 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 Aug 28 09:08:54 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:54 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164" returned: 0 in 0.370s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:54 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 1G Aug 28 09:08:54 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:54 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 1G" returned: 0 in 0.425s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15794cd8-4403-4941-ba53-3a01cb7e6164 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:54 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15794cd8-4403-4941-ba53-3a01cb7e6164 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 Aug 28 09:08:54 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (098f2d67-6260-47bc-b5e7-b1d9bf6794bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22815d48-29ba-429c-a34f-b85b72e11494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22815d48-29ba-429c-a34f-b85b72e11494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923891095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a255f33d-b179-4575-bf1d-800055e82fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:55Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f94ff1-e320-4ef7-95fa-f99950770224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f94ff1-e320-4ef7-95fa-f99950770224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d65b58e-7ec7-4d1f-aaf2-540c47ccba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d65b58e-7ec7-4d1f-aaf2-540c47ccba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a255f33d-b179-4575-bf1d-800055e82fe3', 'volume_name': 'volume-a255f33d-b179-4575-bf1d-800055e82fe3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad2c71-6fb8-46a4-b495-f6ba0d2a0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad2c71-6fb8-46a4-b495-f6ba0d2a0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2d010-bd66-4b41-8ff9-5128e7824fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Volume a255f33d-b179-4575-bf1d-800055e82fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a255f33d-b179-4575-bf1d-800055e82fe3', 'volume_size': 1} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-1f6c883d-5f35-42df-9ad5-9653aeebfa23-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-1f6c883d-5f35-42df-9ad5-9653aeebfa23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Deleting offline snapshot 1f6c883d-5f35-42df-9ad5-9653aeebfa23 of volume 5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] snapshot_file for this snap is: volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce3e43a-e207-42f1-bd22-056f373c6f58]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:55 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15794cd8-4403-4941-ba53-3a01cb7e6164 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6" returned: 0 in 0.332s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:55 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 is being set with open permissions: ugo+rw Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:55 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 Aug 28 09:08:55 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:55 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:55 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:55 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6" returned: 0 in 0.239s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:55 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info Aug 28 09:08:55 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:55 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.361s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[969abb2d-9d07-481e-8083-2841911d118a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:55 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:55 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:55 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info" returned: 0 in 0.265s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:55 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info is being set with open permissions: ugo+rw Aug 28 09:08:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:55 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info Aug 28 09:08:55 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.info" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923891095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a255f33d-b179-4575-bf1d-800055e82fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:08:55Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Creating volume a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:08:56 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 1073741824 Aug 28 09:08:56 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e6f87c96-31a2-4d60-94dc-d48e33f92d44 tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:08:56 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.568s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:56 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-f16b98d9-d3f2-4f4b-9846-268cb14850e6-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-f16b98d9-d3f2-4f4b-9846-268cb14850e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-f16b98d9-d3f2-4f4b-9846-268cb14850e6" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f16b98d9-d3f2-4f4b-9846-268cb14850e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot f16b98d9-d3f2-4f4b-9846-268cb14850e6 of volume 15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91a924-8ec0-420f-8e19-0186bf9a8b92]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.373s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 1073741824" returned: 0 in 0.485s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 Aug 28 09:08:56 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23 Aug 28 09:08:56 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 Aug 28 09:08:56 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:56 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07.1f6c883d-5f35-42df-9ad5-9653aeebfa23" returned: 0 in 0.281s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3" returned: 0 in 0.267s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:56 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-1f6c883d-5f35-42df-9ad5-9653aeebfa23" released by "_delete_snapshot" :: held 1.696s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15794cd8-4403-4941-ba53-3a01cb7e6164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" released by "delete_snapshot" :: held 1.739s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2d010-bd66-4b41-8ff9-5128e7824fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a255f33d-b179-4575-bf1d-800055e82fe3', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50acbc94-1803-44a7-8c4f-0ed3597aa059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a523561-a6a9-4b90-b666-565c7af98730]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:56 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Volume volume-a255f33d-b179-4575-bf1d-800055e82fe3 (a255f33d-b179-4575-bf1d-800055e82fe3): created successfully Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50acbc94-1803-44a7-8c4f-0ed3597aa059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:08:56 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (098f2d67-6260-47bc-b5e7-b1d9bf6794bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:08:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9fe7c144-58a9-4fc0-bc20-c6910d9e6c51 tempest-ProjectReaderTests-171513888 None] Created volume successfully. Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Created reservations ['a7d79e81-2afa-486c-b72a-22bd8fa7d7ca', '89d874f6-c860-473f-aaa0-95226d5fa8ee', 'defd1c6e-bea2-443c-9c91-443d03e1139e', 'caaff62a-115a-4b0b-887b-0509d8cd81f3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:57 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 Aug 28 09:08:57 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:57 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Delete snapshot completed successfully. Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7d9ba31c-85ad-4978-82b3-3615a3983dc2 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-1f6c883d-5f35-42df-9ad5-9653aeebfa23-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-5ac34670-10d4-4c21-b5b5-fced53c6ae07-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:57 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164" returned: 0 in 0.379s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-5ac34670-10d4-4c21-b5b5-fced53c6ae07-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:57 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 Aug 28 09:08:57 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[196438fb-d592-4582-aca9-221f762b546f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:57 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:57 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:57 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6" returned: 0 in 0.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:57 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6 Aug 28 09:08:57 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:57 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.363s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:57 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07 Aug 28 09:08:57 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:57 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164.f16b98d9-d3f2-4f4b-9846-268cb14850e6" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f16b98d9-d3f2-4f4b-9846-268cb14850e6" released by "_delete_snapshot" :: held 1.552s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:57 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" released by "delete_snapshot" :: held 1.577s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Created reservations ['893b1203-3974-4699-b3e9-3c7dce3833e1', '175766d2-8a05-403f-b08b-5416121a2667', '770bd1c0-108c-4ba6-97e4-1d9d305fb2be', 'b7086d42-f9da-4248-8ccf-6e29510c4dc1'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:58 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-5ac34670-10d4-4c21-b5b5-fced53c6ae07" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-5ac34670-10d4-4c21-b5b5-fced53c6ae07" released by "delete_volume" :: held 0.697s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Created reservations ['698a6dbc-a782-4c78-ace4-95cdd04af75a', '42a67d2f-7bef-4b21-8241-07121dd7a2ce', '571ca38a-9a81-4099-af03-2beae6e4c4c5', '907a140b-7e13-42d9-a362-4cf6d65fd282'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-6b2e9af3-5b09-48cd-9250-c46ff049f13c tempest-ProjectMemberTests-979591955 None] Lock "cinder-f16b98d9-d3f2-4f4b-9846-268cb14850e6-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:58 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:58 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Creating offline snapshot 7a306d50-fabb-4e31-8edf-ca42ec7667d9 of volume a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa164fd-6246-4e5a-8691-36060748b1ae]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-257bd7be-5a65-4371-a8f9-35babb3fda18-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:58 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 Aug 28 09:08:58 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-257bd7be-5a65-4371-a8f9-35babb3fda18-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:58 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.308s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-15794cd8-4403-4941-ba53-3a01cb7e6164-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Deleted volume successfully. Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb3a2b-db79-4d73-b06b-eea824a8fdc0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "cinder-15794cd8-4403-4941-ba53-3a01cb7e6164-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c02a202a-25ed-4c86-99e0-fcbc953cfc79 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-5ac34670-10d4-4c21-b5b5-fced53c6ae07-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d5c58-85f3-4409-9947-15c5731b488b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:58 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 Aug 28 09:08:58 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:58 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3" returned: 0 in 0.485s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:58 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 1G Aug 28 09:08:58 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:58 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 Aug 28 09:08:58 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18" returned: 0 in 0.469s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18 Aug 28 09:08:59 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164 Aug 28 09:08:59 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 1G" returned: 0 in 0.504s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255f33d-b179-4575-bf1d-800055e82fe3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255f33d-b179-4575-bf1d-800055e82fe3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 Aug 28 09:08:59 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-257bd7be-5a65-4371-a8f9-35babb3fda18" returned: 0 in 0.304s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-quobyte-257bd7be-5a65-4371-a8f9-35babb3fda18" released by "delete_volume" :: held 0.847s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:59 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-15794cd8-4403-4941-ba53-3a01cb7e6164" returned: 0 in 0.266s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-15794cd8-4403-4941-ba53-3a01cb7e6164" released by "delete_volume" :: held 0.739s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Created reservations ['0e72ac77-330d-42d5-acbb-f0f548335dd7', 'ef041f1c-8e66-4d62-ad07-9ff63a131d7c', 'f88274ae-0304-4b06-9aba-82aa8cf5bcbd', '5a34b37b-bea1-42af-aa1d-809c735fb4fb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Created reservations ['98e5c3cc-d707-4362-9cc4-dd3ed10daff0', 'a4471e34-6c2f-4f48-ab36-fe38a1512a0f', '3a68a1e2-638f-4406-89ea-725af792468d', '136a41f3-bf9b-4332-a53a-8b0e7ed00081'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:59 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a255f33d-b179-4575-bf1d-800055e82fe3 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9" returned: 0 in 0.406s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 is being set with open permissions: ugo+rw Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:08:59 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:08:59 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 Aug 28 09:08:59 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:08:59 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.293s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:08:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Deleted volume successfully. Aug 28 09:08:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7802fd64-b207-4adf-8694-7bccfa1204a0 tempest-SnapshotDependencyTests-894715995 None] Lock "cinder-257bd7be-5a65-4371-a8f9-35babb3fda18-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:00 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:00 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9" returned: 0 in 0.353s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-78d0229b-00cc-4cb9-b8cc-d8cb4203c105 tempest-ProjectMemberTests-979591955 None] Lock "cinder-15794cd8-4403-4941-ba53-3a01cb7e6164-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:00 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info Aug 28 09:09:00 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:00 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (99281100-3070-4c8e-93f3-159205693620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354d2709-ef33-4bbb-bd79-25600ab297b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info" returned: 0 in 0.330s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:00 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info is being set with open permissions: ugo+rw Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354d2709-ef33-4bbb-bd79-25600ab297b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076862395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d6ce4d-3821-4793-9f0e-8b791a9d0215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:00Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a2434-fa91-4f4b-8048-7246248578e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:00 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info Aug 28 09:09:00 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a2434-fa91-4f4b-8048-7246248578e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae48acab-510f-4be3-8fb0-2757284a0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae48acab-510f-4be3-8fb0-2757284a0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d6ce4d-3821-4793-9f0e-8b791a9d0215', 'volume_name': 'volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d16e88-3176-44dd-b962-ca7200aa64c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d16e88-3176-44dd-b962-ca7200aa64c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b287e5-561e-4a58-8c51-18ade3d10940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Volume 16d6ce4d-3821-4793-9f0e-8b791a9d0215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215', 'volume_size': 1} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:00 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.info" returned: 0 in 0.287s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.250s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076862395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d6ce4d-3821-4793-9f0e-8b791a9d0215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:00Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Creating volume 16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:00 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 1073741824 Aug 28 09:09:00 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1a331ae0-05bd-4380-b9a5-0b0706d017c6 tempest-ProjectReaderTests-171513888 None] Create snapshot completed successfully Aug 28 09:09:01 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 1073741824" returned: 0 in 0.419s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:01 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 Aug 28 09:09:01 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-7a306d50-fabb-4e31-8edf-ca42ec7667d9-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-7a306d50-fabb-4e31-8edf-ca42ec7667d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-7a306d50-fabb-4e31-8edf-ca42ec7667d9" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-7a306d50-fabb-4e31-8edf-ca42ec7667d9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Deleting offline snapshot 7a306d50-fabb-4e31-8edf-ca42ec7667d9 of volume a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:01 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] snapshot_file for this snap is: volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215" returned: 0 in 0.342s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a9029-549f-4a2b-af67-d22e15a99770]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b287e5-561e-4a58-8c51-18ade3d10940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c723ea-ebc3-430d-b303-ed883bdfd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:01 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Volume volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 (16d6ce4d-3821-4793-9f0e-8b791a9d0215): created successfully Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c723ea-ebc3-430d-b303-ed883bdfd512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (99281100-3070-4c8e-93f3-159205693620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:01 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a5961f8b-361a-48d0-b41a-de17961d36a7 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:01 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 Aug 28 09:09:01 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:01 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9" returned: 0 in 0.373s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a255f33d-b179-4575-bf1d-800055e82fe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb3421-673a-45c7-9ba6-938213d8a481]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:02 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 Aug 28 09:09:02 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:02 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3" returned: 0 in 0.417s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:02 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 Aug 28 09:09:02 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 1f46c226-14df-475c-b4b7-e3efdfb582b2 of volume 16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411cfda-2fb4-4b5d-a29d-0a7b7de2f4c1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:02 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9" returned: 0 in 0.364s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:02 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9 Aug 28 09:09:02 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:02 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 Aug 28 09:09:02 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:03 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3.7a306d50-fabb-4e31-8edf-ca42ec7667d9" returned: 0 in 0.253s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-7a306d50-fabb-4e31-8edf-ca42ec7667d9" released by "_delete_snapshot" :: held 1.510s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" released by "delete_snapshot" :: held 1.535s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:03 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215" returned: 0 in 0.383s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:03 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 1G Aug 28 09:09:03 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Created reservations ['614c4a9b-1ca4-455f-9943-b83b07892450', 'db2dc2f5-eb8e-40dd-a3f4-e28d3db001ee', 'bef2d22f-c622-4d16-8424-7033afec6210', '55213496-9e00-4629-92dd-608deec8974f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Delete snapshot completed successfully. Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-cd03feba-7195-4c38-89e4-10f823ab71db tempest-ProjectReaderTests-171513888 None] Lock "cinder-7a306d50-fabb-4e31-8edf-ca42ec7667d9-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:03 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 1G" returned: 0 in 0.495s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:03 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 Aug 28 09:09:03 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-a255f33d-b179-4575-bf1d-800055e82fe3-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-a255f33d-b179-4575-bf1d-800055e82fe3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed5d89-c85d-481a-ade7-234bdb5f5112]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2" returned: 0 in 0.399s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 is being set with open permissions: ugo+rw Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 Aug 28 09:09:04 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 Aug 28 09:09:04 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3" returned: 0 in 0.434s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info Aug 28 09:09:04 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3 Aug 28 09:09:04 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info" returned: 0 in 0.294s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info is being set with open permissions: ugo+rw Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info Aug 28 09:09:04 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-a255f33d-b179-4575-bf1d-800055e82fe3" returned: 0 in 0.317s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-a255f33d-b179-4575-bf1d-800055e82fe3" released by "delete_volume" :: held 0.831s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Created reservations ['e20a2e8f-26e8-4fdb-a2b1-9cb69da8c0ef', '5794599f-6a76-4080-b05e-d3eb1721bf25', 'b1cfc704-c511-41f5-bb00-b5938a3255a6', 'f6cbb503-3501-4894-a59c-9cbc58a36dd9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:04 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:04 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:04 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.info" returned: 0 in 0.262s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-215fd1da-658d-43dd-85b7-53932c72fc7d tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:05 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.301s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:05 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Deleted volume successfully. Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d6137b3-c62a-4c15-83dd-94ba11df17d1 tempest-ProjectReaderTests-171513888 None] Lock "cinder-a255f33d-b179-4575-bf1d-800055e82fe3-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (feecacf6-1c82-4fd7-a0e0-c34b18d5cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbf21fa-330b-43e9-ab96-27f66b28f89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbf21fa-330b-43e9-ab96-27f66b28f89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199282455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82def2f9-450b-4223-becd-1e1a28c893b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:05Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c338e44a-6cf3-4ee4-ae20-c85d3d4b5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c338e44a-6cf3-4ee4-ae20-c85d3d4b5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad9ad8c-9d45-462f-bfdc-8f52666b6077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad9ad8c-9d45-462f-bfdc-8f52666b6077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82def2f9-450b-4223-becd-1e1a28c893b2', 'volume_name': 'volume-82def2f9-450b-4223-becd-1e1a28c893b2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40f1d44-62f5-4c9a-981d-dab3ada47c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40f1d44-62f5-4c9a-981d-dab3ada47c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720fe9c-5f76-46e9-a606-e169182f4544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:05 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Volume 82def2f9-450b-4223-becd-1e1a28c893b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82def2f9-450b-4223-becd-1e1a28c893b2', 'volume_size': 1} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199282455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82def2f9-450b-4223-becd-1e1a28c893b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:05Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Creating volume 82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:05 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:05 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 1073741824 Aug 28 09:09:05 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-1f46c226-14df-475c-b4b7-e3efdfb582b2-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-1f46c226-14df-475c-b4b7-e3efdfb582b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-1f46c226-14df-475c-b4b7-e3efdfb582b2" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-1f46c226-14df-475c-b4b7-e3efdfb582b2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:05 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 1f46c226-14df-475c-b4b7-e3efdfb582b2 of volume 16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045fe98-441e-4d02-b531-e91588ab2f03]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:06 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 1073741824" returned: 0 in 0.486s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:06 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 Aug 28 09:09:06 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:06 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 Aug 28 09:09:06 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:06 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2" returned: 0 in 0.283s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720fe9c-5f76-46e9-a606-e169182f4544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82def2f9-450b-4223-becd-1e1a28c893b2', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9661295-1dae-4f97-91d7-f7446062c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:06 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Volume volume-82def2f9-450b-4223-becd-1e1a28c893b2 (82def2f9-450b-4223-becd-1e1a28c893b2): created successfully Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9661295-1dae-4f97-91d7-f7446062c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (feecacf6-1c82-4fd7-a0e0-c34b18d5cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:06 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-e563585f-5b76-47d5-b816-cf61fcf99cc1 tempest-ProjectReaderTests-171513888 None] Created volume successfully. Aug 28 09:09:06 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2" returned: 0 in 0.432s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dbf2de-e90f-4d6d-aadb-bb472d4e1a6f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:06 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 Aug 28 09:09:06 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:06 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215" returned: 0 in 0.364s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:06 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:06 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 Aug 28 09:09:06 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:07 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2" returned: 0 in 0.340s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:07 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2 Aug 28 09:09:07 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:07 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215.1f46c226-14df-475c-b4b7-e3efdfb582b2" returned: 0 in 0.242s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-1f46c226-14df-475c-b4b7-e3efdfb582b2" released by "_delete_snapshot" :: held 1.485s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" released by "delete_snapshot" :: held 1.509s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Created reservations ['0dc74768-1fa7-4f1d-968f-f5f9c2d09a4b', 'af7c81f4-7cd9-4722-9dd6-f29df8aa9b6d', '86238570-04a6-42e7-ba28-b2514b2abce9', '6ac5611b-f4d5-4f34-866d-e85c8ec5878c'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:07 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-32fb05ee-b021-43eb-b88e-2e5ff4541d16 tempest-ProjectMemberTests-979591955 None] Lock "cinder-1f46c226-14df-475c-b4b7-e3efdfb582b2-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Creating offline snapshot 35de517d-f015-44b0-aa41-65f0abdf4192 of volume 82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edc3c7-8bf0-44ff-a82b-cb53b658b54b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:07 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:07 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 Aug 28 09:09:07 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-16d6ce4d-3821-4793-9f0e-8b791a9d0215-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "cinder-16d6ce4d-3821-4793-9f0e-8b791a9d0215-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:08 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2" returned: 0 in 0.432s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4a172-2b6d-4c4f-8926-b4f14e2c1716]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:08 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 1G Aug 28 09:09:08 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:08 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 Aug 28 09:09:08 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:08 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:08 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 1G" returned: 0 in 0.405s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82def2f9-450b-4223-becd-1e1a28c893b2 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:08 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215 Aug 28 09:09:08 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:08 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82def2f9-450b-4223-becd-1e1a28c893b2 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 Aug 28 09:09:08 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:08 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-16d6ce4d-3821-4793-9f0e-8b791a9d0215" returned: 0 in 0.290s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-16d6ce4d-3821-4793-9f0e-8b791a9d0215" released by "delete_volume" :: held 0.757s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:08 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82def2f9-450b-4223-becd-1e1a28c893b2 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192" returned: 0 in 0.350s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:08 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 is being set with open permissions: ugo+rw Aug 28 09:09:08 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:09 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 Aug 28 09:09:09 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Created reservations ['103074f0-160c-4f0c-8eb9-43fb667c1245', '386f97a2-3d20-4e24-a707-a66784af05cc', 'f771de80-6337-4774-9877-e2152fc75be9', '05872fdc-0086-441f-8950-c226aee7e748'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:09 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:09 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:09 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192" returned: 0 in 0.287s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:09 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info Aug 28 09:09:09 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:09 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.288s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:09 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-c0dd4ece-644c-4383-abc9-238d0235e997 tempest-ProjectMemberTests-979591955 None] Lock "cinder-16d6ce4d-3821-4793-9f0e-8b791a9d0215-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:09 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info" returned: 0 in 0.282s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:09 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info is being set with open permissions: ugo+rw Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:09 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info Aug 28 09:09:09 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (ccb8e23b-910a-4b92-a9a4-47646f1a0437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d37b38-d84b-408c-8d7c-7bae923e30f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:09 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d37b38-d84b-408c-8d7c-7bae923e30f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983833142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d72d75-589b-4836-8cfb-d9774980dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:10Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18683fb-4ba2-43b0-a353-d17fb5d3cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18683fb-4ba2-43b0-a353-d17fb5d3cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d70559-d5a0-467d-bb88-122e85733927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d70559-d5a0-467d-bb88-122e85733927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d72d75-589b-4836-8cfb-d9774980dc88', 'volume_name': 'volume-68d72d75-589b-4836-8cfb-d9774980dc88', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85472e8e-14f9-4a3d-a2a3-c9482a875f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85472e8e-14f9-4a3d-a2a3-c9482a875f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837a6a16-1a96-42c7-b3d3-8a0fcdfcbc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:09 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Volume 68d72d75-589b-4836-8cfb-d9774980dc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d72d75-589b-4836-8cfb-d9774980dc88', 'volume_size': 1} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.info" returned: 0 in 0.344s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983833142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d72d75-589b-4836-8cfb-d9774980dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:10Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Creating volume 68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:09 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:09 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:09 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 1073741824 Aug 28 09:09:09 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3ddd56eb-2acc-414e-af9d-61b1141afbda tempest-ProjectReaderTests-171513888 None] Create snapshot completed successfully Aug 28 09:09:10 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 1073741824" returned: 0 in 0.426s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:10 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 Aug 28 09:09:10 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:10 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88" returned: 0 in 0.248s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837a6a16-1a96-42c7-b3d3-8a0fcdfcbc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d72d75-589b-4836-8cfb-d9774980dc88', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137af408-657e-40e6-8b55-44320f13bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:10 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Volume volume-68d72d75-589b-4836-8cfb-d9774980dc88 (68d72d75-589b-4836-8cfb-d9774980dc88): created successfully Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137af408-657e-40e6-8b55-44320f13bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (ccb8e23b-910a-4b92-a9a4-47646f1a0437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:10 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a6a2139a-814f-476c-88ba-938db5ac4703 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-35de517d-f015-44b0-aa41-65f0abdf4192-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-35de517d-f015-44b0-aa41-65f0abdf4192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:10 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-35de517d-f015-44b0-aa41-65f0abdf4192" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-35de517d-f015-44b0-aa41-65f0abdf4192" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Deleting offline snapshot 35de517d-f015-44b0-aa41-65f0abdf4192 of volume 82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] snapshot_file for this snap is: volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921913b-47d9-438d-a390-9a7b7f93d728]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc of volume 68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e293c-3882-4ebb-9880-995a3daff018]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:11 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 Aug 28 09:09:11 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:11 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 Aug 28 09:09:11 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:11 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192" returned: 0 in 0.404s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82def2f9-450b-4223-becd-1e1a28c893b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f221aa-0ac0-4e75-aad6-dfd8747015c7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:11 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88" returned: 0 in 0.410s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:11 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:11 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc 1G Aug 28 09:09:11 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:11 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 Aug 28 09:09:11 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2" returned: 0 in 0.452s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 Aug 28 09:09:12 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc 1G" returned: 0 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d72d75-589b-4836-8cfb-d9774980dc88 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d72d75-589b-4836-8cfb-d9774980dc88 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc Aug 28 09:09:12 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192 Aug 28 09:09:12 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d72d75-589b-4836-8cfb-d9774980dc88 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" returned: 0 in 0.329s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc is being set with open permissions: ugo+rw Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc Aug 28 09:09:12 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2.35de517d-f015-44b0-aa41-65f0abdf4192" returned: 0 in 0.263s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-35de517d-f015-44b0-aa41-65f0abdf4192" released by "_delete_snapshot" :: held 1.631s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" released by "delete_snapshot" :: held 1.680s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:12 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info Aug 28 09:09:12 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Created reservations ['c68a6125-ec86-454c-9a71-14e175d8f7d0', 'dc0e2fa9-28ef-46e0-8afd-c1614790d729', 'db3d07c1-4e35-41bc-9f01-091b8febc9ac', '5d928663-6825-4e43-9880-bf86cdfd1acb'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:12 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Delete snapshot completed successfully. Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-ac59a9b1-c700-44c4-885f-2b357f66e718 tempest-ProjectReaderTests-171513888 None] Lock "cinder-35de517d-f015-44b0-aa41-65f0abdf4192-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:12 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:12 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info is being set with open permissions: ugo+rw Aug 28 09:09:12 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:12 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info Aug 28 09:09:12 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-82def2f9-450b-4223-becd-1e1a28c893b2-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "cinder-82def2f9-450b-4223-becd-1e1a28c893b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:13 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.info" returned: 0 in 0.280s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[874931eb-43f0-4fc2-bba7-7f897c3b1a7d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:13 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5be33e3d-5439-4623-be3f-73733e0f5bff tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:13 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 Aug 28 09:09:13 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:13 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2" returned: 0 in 0.377s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:13 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2 Aug 28 09:09:13 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:13 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-82def2f9-450b-4223-becd-1e1a28c893b2" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-82def2f9-450b-4223-becd-1e1a28c893b2" released by "delete_volume" :: held 0.690s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:13 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Created reservations ['4d5ba5f3-8359-47c3-8498-0da46c9e44de', '30346d24-d6ac-45e1-8b20-48b51c296908', 'd94606d3-1020-416b-aaee-447ba500fc9a', '5fca5caa-7af2-4b50-80a0-5e2b61410823'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:14 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:14 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:14 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.252s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:14 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Deleted volume successfully. Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-29e8059f-c5bf-4041-ade1-ab78306fc545 tempest-ProjectReaderTests-171513888 None] Lock "cinder-82def2f9-450b-4223-becd-1e1a28c893b2-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc of volume 68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[583282f3-303f-4a67-b332-fba5d9b592d0]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:14 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc Aug 28 09:09:14 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:14 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" returned: 0 in 0.414s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d72d75-589b-4836-8cfb-d9774980dc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed8568e-defc-4afa-b879-bcc2a28caeda]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (6d1f40ca-a341-4553-afe8-f19b00ffb4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4fa9d-a632-494f-a0c2-ddeafedcd706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f4fa9d-a632-494f-a0c2-ddeafedcd706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955686330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5bc8e7-ad9c-4a24-892a-881e4df413df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:15Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9000429c-1254-4c72-9b70-b4cfc203c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9000429c-1254-4c72-9b70-b4cfc203c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f364764-5889-4043-b757-3b2e93dd64d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f364764-5889-4043-b757-3b2e93dd64d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5bc8e7-ad9c-4a24-892a-881e4df413df', 'volume_name': 'volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50e4638-792a-4b88-be55-3d9f6e670fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50e4638-792a-4b88-be55-3d9f6e670fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1981951b-aa23-47c6-b17c-14d93d381a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:14 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Volume cc5bc8e7-ad9c-4a24-892a-881e4df413df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df', 'volume_size': 1} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955686330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5bc8e7-ad9c-4a24-892a-881e4df413df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c1090d996b4cd3ab4cc1c602767994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:15Z,use_quota=True,user_id='993d73722eba468d851ca37c52f7b607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Creating volume cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:14 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:14 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:14 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 Aug 28 09:09:14 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:15 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df 1073741824 Aug 28 09:09:15 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:15 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88" returned: 0 in 0.389s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:15 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc Aug 28 09:09:15 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:15 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df 1073741824" returned: 0 in 0.446s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:15 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df Aug 28 09:09:15 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:15 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" returned: 0 in 0.350s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:15 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc Aug 28 09:09:15 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:15 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1981951b-aa23-47c6-b17c-14d93d381a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d20011-cdde-496e-ad6a-58ed3c6c1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:15 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Volume volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df (cc5bc8e7-ad9c-4a24-892a-881e4df413df): created successfully Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d20011-cdde-496e-ad6a-58ed3c6c1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Flow 'volume_create_manager' (6d1f40ca-a341-4553-afe8-f19b00ffb4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:15 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9dd69b11-1571-4b6a-af58-627faaf7c202 tempest-ProjectReaderTests-171513888 None] Created volume successfully. Aug 28 09:09:15 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88.1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" returned: 0 in 0.279s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc" released by "_delete_snapshot" :: held 1.538s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" released by "delete_snapshot" :: held 1.560s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=153,cinder:INSERT=55,cinder:UPDATE=193,cinder:DELETE=21 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Created reservations ['40b1230b-6246-41be-9b01-bc84d1213ec7', '0b943392-5554-431e-8d4e-fc0eccfa7f26', 'b14ad789-f7a4-4e3d-974c-c93e13d6e0ee', '53dfe2cf-2b0e-40b5-bb21-2769e96ba357'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:15 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:SELECT=162,cinder:INSERT=55,cinder:UPDATE=201,cinder:DELETE=13 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:09:16 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-1e363ba6-9271-4684-8d52-29cb728abf9f tempest-ProjectMemberTests-979591955 None] Lock "cinder-1fd69ae2-8b97-4607-b9c5-62ec6ba1f6cc-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-68d72d75-589b-4836-8cfb-d9774980dc88-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "cinder-68d72d75-589b-4836-8cfb-d9774980dc88-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e0c8a-0fae-4d0b-806e-f0e1651d65a4]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:16 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 Aug 28 09:09:16 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:16 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:16 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88" returned: 0 in 0.421s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:17 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88 Aug 28 09:09:17 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Creating offline snapshot fb3b9633-b76e-49e6-b571-aa25486e7baf of volume cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0201ed-750f-430c-a4f0-4262df1820ff]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:17 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df Aug 28 09:09:17 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:17 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-68d72d75-589b-4836-8cfb-d9774980dc88" returned: 0 in 0.291s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-68d72d75-589b-4836-8cfb-d9774980dc88" released by "delete_volume" :: held 0.772s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Created reservations ['a37d92f0-1fe1-446b-a79f-08511296da8d', '7ba6e9d0-8e5a-4caf-8b20-59e2b510e692', '3b1a7d4a-0365-4ce7-8203-c2e0435b76ee', '9538ccbc-9f26-422b-a439-45664568138f'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:17 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:17 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:17 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df" returned: 0 in 0.416s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:17 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf 1G Aug 28 09:09:17 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:17 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.283s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:17 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:17 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-93b4495c-a32f-4ba9-a207-1686ed295a80 tempest-ProjectMemberTests-979591955 None] Lock "cinder-68d72d75-589b-4836-8cfb-d9774980dc88-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:18 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf 1G" returned: 0 in 0.477s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:18 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf Aug 28 09:09:18 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (a5e904b3-f4d4-4d01-8e5e-917ead9fcef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9966fb0c-37d9-46a6-bdde-e38ac7f23c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9966fb0c-37d9-46a6-bdde-e38ac7f23c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651182341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1293af1-f228-4503-aabe-993554581fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:18Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeef3ae-65aa-4ffa-bf6c-454f9cda467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeef3ae-65aa-4ffa-bf6c-454f9cda467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309ceeef-793c-48b9-83af-c677afa2e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309ceeef-793c-48b9-83af-c677afa2e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1293af1-f228-4503-aabe-993554581fa6', 'volume_name': 'volume-f1293af1-f228-4503-aabe-993554581fa6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aabee2-f5a5-48dc-8d0b-adf60fec7a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aabee2-f5a5-48dc-8d0b-adf60fec7a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e82b76-fc5b-45c5-a035-cada860d813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:18 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Volume f1293af1-f228-4503-aabe-993554581fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1293af1-f228-4503-aabe-993554581fa6', 'volume_size': 1} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:18 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf" returned: 0 in 0.314s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:18 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf is being set with open permissions: ugo+rw Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:18 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf Aug 28 09:09:18 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:18 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf" returned: 0 in 0.238s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:18 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info Aug 28 09:09:18 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:18 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info" returned: 0 in 0.265s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:18 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info is being set with open permissions: ugo+rw Aug 28 09:09:18 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:18 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info Aug 28 09:09:18 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:19 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.info" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651182341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1293af1-f228-4503-aabe-993554581fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:18Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Creating volume f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:19 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:19 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 1073741824 Aug 28 09:09:19 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-74603b18-0343-4a71-8664-a391c3e15bb3 tempest-ProjectReaderTests-171513888 None] Create snapshot completed successfully Aug 28 09:09:19 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 1073741824" returned: 0 in 0.436s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:19 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 Aug 28 09:09:19 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:19 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e82b76-fc5b-45c5-a035-cada860d813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1293af1-f228-4503-aabe-993554581fa6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff7c989-e22c-4328-a596-3f815f37875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:19 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Volume volume-f1293af1-f228-4503-aabe-993554581fa6 (f1293af1-f228-4503-aabe-993554581fa6): created successfully Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff7c989-e22c-4328-a596-3f815f37875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:19 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (a5e904b3-f4d4-4d01-8e5e-917ead9fcef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:19 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a8ac7ea8-6162-4f68-aed8-f16179f2bb5a tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-fb3b9633-b76e-49e6-b571-aa25486e7baf-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-fb3b9633-b76e-49e6-b571-aa25486e7baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-fb3b9633-b76e-49e6-b571-aa25486e7baf" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-fb3b9633-b76e-49e6-b571-aa25486e7baf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Deleting offline snapshot fb3b9633-b76e-49e6-b571-aa25486e7baf of volume cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] snapshot_file for this snap is: volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5b962-37bf-4139-991e-10dfa4ba2fcc]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 7fcd60f3-74c2-42d5-86cd-2a45e270532a of volume f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a4305-e0bc-4193-a8d0-69710db4e061]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:20 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf Aug 28 09:09:20 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:20 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 Aug 28 09:09:20 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:20 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf" returned: 0 in 0.404s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[268bc207-03f0-4edf-ba74-492b66fc84fe]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:20 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:20 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:20 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a 1G Aug 28 09:09:20 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:20 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df Aug 28 09:09:20 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df" returned: 0 in 0.375s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:21 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf Aug 28 09:09:21 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a 1G" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1293af1-f228-4503-aabe-993554581fa6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:21 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1293af1-f228-4503-aabe-993554581fa6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a Aug 28 09:09:21 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf" returned: 0 in 0.358s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:21 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1293af1-f228-4503-aabe-993554581fa6 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a" returned: 0 in 0.314s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a is being set with open permissions: ugo+rw Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:21 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf Aug 28 09:09:21 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a Aug 28 09:09:21 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df.fb3b9633-b76e-49e6-b571-aa25486e7baf" returned: 0 in 0.244s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a" returned: 0 in 0.244s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-fb3b9633-b76e-49e6-b571-aa25486e7baf" released by "_delete_snapshot" :: held 1.501s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" released by "delete_snapshot" :: held 1.535s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:21 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info Aug 28 09:09:21 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Created reservations ['62eb0566-edf9-475c-857e-c855f2ff4179', 'ef539be8-bab8-43fb-8909-d2749a78d187', '99b5d5a0-e6bc-473d-8bcd-334c01a9903d', 'f1063c66-5aee-4f0b-a359-46663b404f15'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:21 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Delete snapshot completed successfully. Aug 28 09:09:21 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b6e81ffc-0ecc-4ac8-99ec-57ffacc83337 tempest-ProjectReaderTests-171513888 None] Lock "cinder-fb3b9633-b76e-49e6-b571-aa25486e7baf-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:22 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:22 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info is being set with open permissions: ugo+rw Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:22 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info Aug 28 09:09:22 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:22 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.info" returned: 0 in 0.227s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:22 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f08bc7ab-114f-495f-ba3f-885c3212b922 tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-cc5bc8e7-ad9c-4a24-892a-881e4df413df-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "cinder-cc5bc8e7-ad9c-4a24-892a-881e4df413df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Acquiring lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a3565-e851-4fed-ac60-cf923377fb6b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-7fcd60f3-74c2-42d5-86cd-2a45e270532a-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-7fcd60f3-74c2-42d5-86cd-2a45e270532a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-7fcd60f3-74c2-42d5-86cd-2a45e270532a" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-7fcd60f3-74c2-42d5-86cd-2a45e270532a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 7fcd60f3-74c2-42d5-86cd-2a45e270532a of volume f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7117bb5-00c4-4998-8f84-f2828fd8b695]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:22 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df Aug 28 09:09:22 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:22 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a Aug 28 09:09:22 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:22 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df" returned: 0 in 0.369s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:22 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:22 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df Aug 28 09:09:22 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:23 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a" returned: 0 in 0.353s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1293af1-f228-4503-aabe-993554581fa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b30f75-16fe-43f4-842f-9a0ecc8d498f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:23 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 Aug 28 09:09:23 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:23 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-cc5bc8e7-ad9c-4a24-892a-881e4df413df" returned: 0 in 0.253s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "cinder-quobyte-cc5bc8e7-ad9c-4a24-892a-881e4df413df" released by "delete_volume" :: held 0.689s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Created reservations ['9e25350e-511d-47b9-9794-30d053521717', '965dff28-16a4-4f50-9bd9-6369d2ee6598', '9bd6a118-89d8-493c-b740-f559242848dc', 'ba5a56c2-bd7d-40cd-b87c-28f2af88a4aa'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:23 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:23 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:23 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6" returned: 0 in 0.349s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:23 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a Aug 28 09:09:23 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:23 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:23 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Deleted volume successfully. Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8d8067f8-5044-43cd-8cca-a9fb5b848da2 tempest-ProjectReaderTests-171513888 None] Lock "cinder-cc5bc8e7-ad9c-4a24-892a-881e4df413df-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:23 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a" returned: 0 in 0.348s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:23 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:23 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a Aug 28 09:09:23 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:24 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6.7fcd60f3-74c2-42d5-86cd-2a45e270532a" returned: 0 in 0.249s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-7fcd60f3-74c2-42d5-86cd-2a45e270532a" released by "_delete_snapshot" :: held 1.385s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" released by "delete_snapshot" :: held 1.406s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Created reservations ['bc8ce706-4787-4463-a056-8aab7dcd8924', 'fe2e979b-cc0d-4b58-987d-10c6281a680a', 'efa5b878-66ed-4dd4-84e7-b18b2ce69863', '0be03bac-8f29-415a-be14-f814b9e7c878'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:24 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-b9fb02ef-ed22-4d12-911f-25cb3149ec4e tempest-ProjectMemberTests-979591955 None] Lock "cinder-7fcd60f3-74c2-42d5-86cd-2a45e270532a-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-f1293af1-f228-4503-aabe-993554581fa6-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "cinder-f1293af1-f228-4503-aabe-993554581fa6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" acquired by "delete_volume" :: waited 0.014s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b911d46d-0da5-4574-973b-51315a03c914]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:24 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:24 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 Aug 28 09:09:24 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:25 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6" returned: 0 in 0.388s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:25 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6 Aug 28 09:09:25 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:25 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-f1293af1-f228-4503-aabe-993554581fa6" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-f1293af1-f228-4503-aabe-993554581fa6" released by "delete_volume" :: held 0.699s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Created reservations ['602d777b-711e-4be8-bf9b-e3419e06696d', '51df1f5a-f12e-40ff-9014-9869715d94ca', '95004ecc-810f-4e84-8c06-09f828f9ae87', 'f5e8e5d0-2ab2-4fad-b1b6-fe1bfb4eb5bd'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:25 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:25 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:25 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:25 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:25 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-0dbc874c-6e89-4523-895b-ffe363df49e5 tempest-ProjectMemberTests-979591955 None] Lock "cinder-f1293af1-f228-4503-aabe-993554581fa6-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (cf84a52c-ce66-4a9c-b04a-febd250938a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58b4118-5680-4a1f-8ed6-f0cf2d64e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58b4118-5680-4a1f-8ed6-f0cf2d64e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104573511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51cbc6-275e-45b7-b09e-3cce8dd34004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:26Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169f69d-9b3c-4296-b2cf-1cbe3ee8bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7169f69d-9b3c-4296-b2cf-1cbe3ee8bf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b106b5-b4b1-48af-8cf8-498548f1e92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b106b5-b4b1-48af-8cf8-498548f1e92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df51cbc6-275e-45b7-b09e-3cce8dd34004', 'volume_name': 'volume-df51cbc6-275e-45b7-b09e-3cce8dd34004', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b84afd-dbe2-4e82-950d-a50e7795bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b84afd-dbe2-4e82-950d-a50e7795bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45de5b3-1481-40bf-96eb-41c6fd8c2f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:26 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Volume df51cbc6-275e-45b7-b09e-3cce8dd34004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df51cbc6-275e-45b7-b09e-3cce8dd34004', 'volume_size': 1} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104573511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51cbc6-275e-45b7-b09e-3cce8dd34004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:26Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Creating volume df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:26 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:26 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 1073741824 Aug 28 09:09:26 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:26 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 1073741824" returned: 0 in 0.462s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:26 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:27 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 Aug 28 09:09:27 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:27 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004" returned: 0 in 0.268s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45de5b3-1481-40bf-96eb-41c6fd8c2f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df51cbc6-275e-45b7-b09e-3cce8dd34004', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d5410f-ab64-45a4-9d79-426da66bb156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:27 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Volume volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 (df51cbc6-275e-45b7-b09e-3cce8dd34004): created successfully Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d5410f-ab64-45a4-9d79-426da66bb156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (cf84a52c-ce66-4a9c-b04a-febd250938a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:27 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-6e625f6d-0dd1-47d1-abdb-9f1fcc2c4c19 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Creating offline snapshot c52dcd79-20c1-4999-9baf-879172e895ce of volume df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[816c761f-4278-4cfd-9252-d08364050805]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:27 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:27 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 Aug 28 09:09:27 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:28 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004" returned: 0 in 0.385s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:28 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce 1G Aug 28 09:09:28 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:28 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce 1G" returned: 0 in 0.442s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:28 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce Aug 28 09:09:28 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:28 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce" returned: 0 in 0.331s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:28 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce is being set with open permissions: ugo+rw Aug 28 09:09:28 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:28 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce Aug 28 09:09:28 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:29 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce" returned: 0 in 0.269s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:29 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info Aug 28 09:09:29 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:29 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info" returned: 0 in 0.277s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:29 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info is being set with open permissions: ugo+rw Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:29 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info Aug 28 09:09:29 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:29 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.info" returned: 0 in 0.310s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:29 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:29 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-0b3daf0b-4bad-4de4-b3e5-363d0f73b452 tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-c52dcd79-20c1-4999-9baf-879172e895ce-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c52dcd79-20c1-4999-9baf-879172e895ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-c52dcd79-20c1-4999-9baf-879172e895ce" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c52dcd79-20c1-4999-9baf-879172e895ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot c52dcd79-20c1-4999-9baf-879172e895ce of volume df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[46571f3a-b45d-425e-8f5d-b1fefc6b540b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:30 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:31 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce Aug 28 09:09:31 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:31 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce" returned: 0 in 0.397s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df51cbc6-275e-45b7-b09e-3cce8dd34004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07ca6e-415e-4806-8d2d-ec7057e472e3]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:31 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 Aug 28 09:09:31 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:31 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004" returned: 0 in 0.384s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:31 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:31 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce Aug 28 09:09:31 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:32 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce" returned: 0 in 0.388s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:32 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce Aug 28 09:09:32 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:32 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004.c52dcd79-20c1-4999-9baf-879172e895ce" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c52dcd79-20c1-4999-9baf-879172e895ce" released by "_delete_snapshot" :: held 1.535s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" released by "delete_snapshot" :: held 1.565s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Created reservations ['32232aab-8e65-486f-ab03-944c7d053575', 'e0eb2b9f-fea8-405c-8a67-af1d9d336f93', 'f86fcd1d-1d55-4a11-b7b2-d7316fa66ddb', '24da52f5-e2c6-42ee-9359-52d0035b7c19'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:32 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-9d2d9bac-41a2-4662-a380-080e443fb1a9 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c52dcd79-20c1-4999-9baf-879172e895ce-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-df51cbc6-275e-45b7-b09e-3cce8dd34004-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:32 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "cinder-df51cbc6-275e-45b7-b09e-3cce8dd34004-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd2e4d-1057-401d-9d02-c66acf40231a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:33 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 Aug 28 09:09:33 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:33 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004" returned: 0 in 0.374s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:33 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004 Aug 28 09:09:33 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:33 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-df51cbc6-275e-45b7-b09e-3cce8dd34004" returned: 0 in 0.264s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-df51cbc6-275e-45b7-b09e-3cce8dd34004" released by "delete_volume" :: held 0.699s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Created reservations ['3a6edf9d-dfd3-445e-b635-9423826a22fd', '7a1f5273-9f73-4ae4-a971-05038c20e258', '9ec033bc-22b3-446a-8341-ded27b72f36f', '50a99ad6-0058-42a6-b440-2affbea2aa59'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:33 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:33 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:33 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:34 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.256s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:34 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-7ce7c91c-819a-439f-80b0-247a3d60f563 tempest-ProjectMemberTests-979591955 None] Lock "cinder-df51cbc6-275e-45b7-b09e-3cce8dd34004-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (7132d1f6-584c-401d-8700-56aca5f9765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d51c362-55c4-4736-a0c2-1f638a23017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d51c362-55c4-4736-a0c2-1f638a23017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243168116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24482b0-3bb7-4304-b0ec-01cd8e3a77f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:35Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb75ea6-b00f-4c56-ba72-c1249888cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb75ea6-b00f-4c56-ba72-c1249888cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6468df71-b388-473b-a92b-7d07f840b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6468df71-b388-473b-a92b-7d07f840b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24482b0-3bb7-4304-b0ec-01cd8e3a77f4', 'volume_name': 'volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de8893c-27e6-492f-bb02-eba28d717c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de8893c-27e6-492f-bb02-eba28d717c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c260a-cea4-455c-8702-921ab78cf4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:34 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Volume d24482b0-3bb7-4304-b0ec-01cd8e3a77f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4', 'volume_size': 1} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243168116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24482b0-3bb7-4304-b0ec-01cd8e3a77f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:35Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Creating volume d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:34 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:34 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:34 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 1073741824 Aug 28 09:09:34 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:35 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 1073741824" returned: 0 in 0.473s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:35 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 Aug 28 09:09:35 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:35 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" returned: 0 in 0.251s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c260a-cea4-455c-8702-921ab78cf4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb18fb4f-465c-4b85-a860-514176e42f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:35 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Volume volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 (d24482b0-3bb7-4304-b0ec-01cd8e3a77f4): created successfully Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb18fb4f-465c-4b85-a860-514176e42f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (7132d1f6-584c-401d-8700-56aca5f9765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:35 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-54b73cfb-cec0-4698-891e-55d49fedbfb6 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 244707fd-3c5e-49fa-b89d-7642afc3ae7b of volume d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93510f1-5e27-419e-8e31-83943544cd7d]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:35 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:35 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 Aug 28 09:09:35 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:36 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" returned: 0 in 0.372s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:36 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b 1G Aug 28 09:09:36 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:36 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b 1G" returned: 0 in 0.431s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:36 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:36 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b Aug 28 09:09:36 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:37 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b" returned: 0 in 0.323s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:37 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b is being set with open permissions: ugo+rw Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:37 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b Aug 28 09:09:37 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:37 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b" returned: 0 in 0.248s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:37 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info Aug 28 09:09:37 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:37 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info" returned: 0 in 0.257s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:37 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info is being set with open permissions: ugo+rw Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:37 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info Aug 28 09:09:37 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:37 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.info" returned: 0 in 0.242s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:37 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:37 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8ae07c36-51a5-45df-9af4-5d459adaa8fa tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-244707fd-3c5e-49fa-b89d-7642afc3ae7b-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-244707fd-3c5e-49fa-b89d-7642afc3ae7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-244707fd-3c5e-49fa-b89d-7642afc3ae7b" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-244707fd-3c5e-49fa-b89d-7642afc3ae7b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 244707fd-3c5e-49fa-b89d-7642afc3ae7b of volume d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[76eacaa4-267c-4feb-a81c-8b4f8767e5d7]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:38 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b Aug 28 09:09:38 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:38 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b" returned: 0 in 0.387s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[66517406-adb5-40ef-bea9-785c60fa3190]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:38 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 Aug 28 09:09:38 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:38 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" returned: 0 in 0.380s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:38 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:38 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b Aug 28 09:09:38 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:39 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b" returned: 0 in 0.363s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:39 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b Aug 28 09:09:39 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:39 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4.244707fd-3c5e-49fa-b89d-7642afc3ae7b" returned: 0 in 0.256s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-244707fd-3c5e-49fa-b89d-7642afc3ae7b" released by "_delete_snapshot" :: held 1.494s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" released by "delete_snapshot" :: held 1.517s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Created reservations ['a63caa51-1006-4bcc-9c2a-8ef0357d1bbc', '8f2504b5-ff2e-4f2c-8a0e-a602a2c12898', 'b5a437b7-f8e9-4bc6-adfe-cd766a8e7cef', '67daf904-f0f7-4851-919d-925123f7bbd3'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:39 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:39 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-31ae3aa3-a818-4e0f-906a-06c6758af0fd tempest-ProjectMemberTests-979591955 None] Lock "cinder-244707fd-3c5e-49fa-b89d-7642afc3ae7b-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" acquired by "delete_volume" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[8934c0cc-7cb5-4e55-97ef-a462a8f2cbe1]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:40 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 Aug 28 09:09:40 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:40 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:40 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:40 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.299s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_service.periodic_task [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] Running periodic task VolumeManager._thread_info {{(pid=85762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread count: 28 {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-eb5a5733-0d76-47b7-8db1-0ec986f39ab9 None None] thread info: [<_MainThread(MainThread, started 132664175751296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:09:40 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" returned: 0 in 0.431s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:40 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:40 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4 Aug 28 09:09:40 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:41 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" returned: 0 in 0.285s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4" released by "delete_volume" :: held 0.778s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Created reservations ['00af901d-9d1e-4aa7-80c7-9fae445d0b7b', '1f453348-b198-4013-8f78-e3d7ad5f6fd9', 'dc9c3141-de7f-4015-bf5d-b52cc979d9ea', '174b5931-dce2-4619-996b-578535187063'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:41 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:41 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:41 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.309s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:41 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-8bd7ef5d-7d68-409d-8f0b-a877c9594ab1 tempest-ProjectMemberTests-979591955 None] Lock "cinder-d24482b0-3bb7-4304-b0ec-01cd8e3a77f4-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (f626ed13-627f-4365-98e3-710014c5dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee435862-6b51-4eec-ad99-00ee0e58fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee435862-6b51-4eec-ad99-00ee0e58fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909258585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c170150c-a70c-4165-b53f-4df2a69a0ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:42Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c60615-bfe8-4ddb-ab47-1a368d84d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:41 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c60615-bfe8-4ddb-ab47-1a368d84d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c949566b-5ecd-423a-9dd6-7cd22253d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c949566b-5ecd-423a-9dd6-7cd22253d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c170150c-a70c-4165-b53f-4df2a69a0ad1', 'volume_name': 'volume-c170150c-a70c-4165-b53f-4df2a69a0ad1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbfbc97-aff3-40bf-a5f9-9666e331289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbfbc97-aff3-40bf-a5f9-9666e331289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8126e9-cd4d-48cb-a937-78bcd8fbcff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Volume c170150c-a70c-4165-b53f-4df2a69a0ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c170150c-a70c-4165-b53f-4df2a69a0ad1', 'volume_size': 1} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909258585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c170150c-a70c-4165-b53f-4df2a69a0ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c32e1f3e54436bed7ab10738122a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:42Z,use_quota=True,user_id='cd01641c9db04642a3541b9ec47d05d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Creating volume c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:42 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:42 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 1073741824 Aug 28 09:09:42 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:42 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 1073741824" returned: 0 in 0.472s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:42 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 Aug 28 09:09:42 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:42 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1" returned: 0 in 0.272s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8126e9-cd4d-48cb-a937-78bcd8fbcff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c170150c-a70c-4165-b53f-4df2a69a0ad1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ac5316-f208-402e-a10e-ea35b522e481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:42 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Volume volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 (c170150c-a70c-4165-b53f-4df2a69a0ad1): created successfully Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ac5316-f208-402e-a10e-ea35b522e481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:42 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Flow 'volume_create_manager' (f626ed13-627f-4365-98e3-710014c5dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:42 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4e5ebce7-61aa-48be-b8fd-2e56b2237c07 tempest-ProjectMemberTests-979591955 None] Created volume successfully. Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Creating offline snapshot 41423bbc-45c5-4921-ba34-e30d9d57cf61 of volume c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719dea5-f6e5-45b9-88e7-c98e78675ebe]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:44 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 Aug 28 09:09:44 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:44 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1" returned: 0 in 0.393s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 1G {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:44 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 1G Aug 28 09:09:44 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:44 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:44 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 1G" returned: 0 in 0.427s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:45 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 Aug 28 09:09:45 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:45 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 -F qcow2 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61" returned: 0 in 0.305s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:45 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 is being set with open permissions: ugo+rw Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:45 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 Aug 28 09:09:45 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:45 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61" returned: 0 in 0.272s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:45 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info Aug 28 09:09:45 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:45 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info" returned: 0 in 0.261s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:45 devstack cinder-volume[85762]: WARNING cinder.volume.drivers.remotefs [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info is being set with open permissions: ugo+rw Aug 28 09:09:45 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:45 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info Aug 28 09:09:45 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:46 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.info" returned: 0 in 0.281s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:46 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:46 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-9c77fa6e-03da-4dcc-a14b-e08ab6315b51 tempest-ProjectMemberTests-979591955 None] Create snapshot completed successfully Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-41423bbc-45c5-4921-ba34-e30d9d57cf61-delete_snapshot" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-41423bbc-45c5-4921-ba34-e30d9d57cf61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" by "delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-41423bbc-45c5-4921-ba34-e30d9d57cf61" by "_delete_snapshot" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-41423bbc-45c5-4921-ba34-e30d9d57cf61" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Deleting offline snapshot 41423bbc-45c5-4921-ba34-e30d9d57cf61 of volume c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] snapshot_file for this snap is: volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e81f58-1d60-4143-ac86-65def06a22dd]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:47 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 Aug 28 09:09:47 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:47 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61" returned: 0 in 0.381s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c170150c-a70c-4165-b53f-4df2a69a0ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85762) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[53969955-9dbc-4d51-afc8-41f5c9ee771a]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:47 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:48 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 Aug 28 09:09:48 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:48 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1" returned: 0 in 0.355s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:48 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 Aug 28 09:09:48 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:48 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61" returned: 0 in 0.361s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:48 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61 Aug 28 09:09:48 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:48 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1.41423bbc-45c5-4921-ba34-e30d9d57cf61" returned: 0 in 0.272s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-41423bbc-45c5-4921-ba34-e30d9d57cf61" released by "_delete_snapshot" :: held 1.470s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:48 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" released by "delete_snapshot" :: held 1.494s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Created reservations ['82227233-772e-418e-902f-cc20c71c0cb6', 'f2f20d97-295e-48c9-844b-4dd696591fec', '809b48b7-3301-47f3-853e-2650b0ed84eb', '39db16bb-cb1d-4488-8d76-434060aef9cc'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:49 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Delete snapshot completed successfully. Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-f9bb003d-9707-4446-84ba-60e8dda69a0b tempest-ProjectMemberTests-979591955 None] Lock "cinder-41423bbc-45c5-4921-ba34-e30d9d57cf61-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-c170150c-a70c-4165-b53f-4df2a69a0ad1-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c170150c-a70c-4165-b53f-4df2a69a0ad1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Acquiring lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c24e2a-1052-4280-be47-9fa3d7763568]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:49 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:49 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 Aug 28 09:09:49 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:50 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1" returned: 0 in 0.382s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:50 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1 Aug 28 09:09:50 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:50 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-c170150c-a70c-4165-b53f-4df2a69a0ad1" returned: 0 in 0.255s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "cinder-quobyte-c170150c-a70c-4165-b53f-4df2a69a0ad1" released by "delete_volume" :: held 0.690s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Created reservations ['69c23169-8305-452a-9a74-9057307cab47', '6991e5ca-f38b-4a15-96c2-c29073734f9e', '00e0f226-f208-4753-9f0d-3b269d11af57', 'e8c2a8c8-ab40-4b58-a4c1-faf291646d2d'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:50 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:50 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:50 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.285s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:50 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Deleted volume successfully. Aug 28 09:09:50 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60291124-2171-4cfd-a9f8-111d208a6198 tempest-ProjectMemberTests-979591955 None] Lock "cinder-c170150c-a70c-4165-b53f-4df2a69a0ad1-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (a923f1a9-b003-4328-ab80-ca7433247cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90f780e-c68e-43c1-aaf8-1778a495a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90f780e-c68e-43c1-aaf8-1778a495a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166120926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:55Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a695b578-dbde-4b5c-b876-84a121cfd604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a695b578-dbde-4b5c-b876-84a121cfd604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82554eae-fa86-427c-903e-cf957c1b1dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82554eae-fa86-427c-903e-cf957c1b1dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6', 'volume_name': 'volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fd234-6913-4181-b525-97325ed86041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fd234-6913-4181-b525-97325ed86041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248c94e8-3612-49d6-ae87-0dc7dd3e7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:54 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Volume b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6', 'volume_size': 1} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166120926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:55Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Creating volume b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:54 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:54 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:54 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 1073741824 Aug 28 09:09:54 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:55 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 1073741824" returned: 0 in 0.437s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:55 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 Aug 28 09:09:55 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:55 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" returned: 0 in 0.259s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248c94e8-3612-49d6-ae87-0dc7dd3e7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729aa1e9-50af-4f8a-8950-c2161c0bdc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:55 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Volume volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 (b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6): created successfully Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729aa1e9-50af-4f8a-8950-c2161c0bdc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (a923f1a9-b003-4328-ab80-ca7433247cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:55 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-3bb760e2-6f34-4ff9-b8e7-27311e7fb894 tempest-ProjectReaderTests-878221051 None] Created volume successfully. Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "cinder-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-quobyte-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" acquired by "delete_volume" :: waited 0.019s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7474fa-dd01-4cde-9f84-bec39fbffe36]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:55 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:55 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 Aug 28 09:09:55 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:56 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" returned: 0 in 0.360s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:56 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6 Aug 28 09:09:56 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:56 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" returned: 0 in 0.245s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6" released by "delete_volume" :: held 0.645s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Created reservations ['027245cf-448c-4e83-b108-39357b2d5988', '50c38a6a-4ea5-46ea-8e2c-6ebba04deb13', 'd4538abf-dea1-4160-964a-201fc2be0e4e', '8de42e73-414d-4cad-ad9e-1cb47f4f0c61'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:56 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:56 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:56 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.239s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:56 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Deleted volume successfully. Aug 28 09:09:56 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-60065ba1-ede0-42d7-b61a-6e73565016df tempest-ProjectReaderTests-878221051 None] Lock "cinder-b897c02a-2ee3-4059-8f3a-1ca4a7d80ce6-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (3a8022d1-673e-4a55-8793-c9476c860eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc72622-88cc-4665-ae79-e9104f96342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc72622-88cc-4665-ae79-e9104f96342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422321577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b690ae3a-5791-4316-a6eb-865a1d5755a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:57Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8387f890-dee8-4772-a89e-36e432b7ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8387f890-dee8-4772-a89e-36e432b7ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aedc233-83cb-4915-b490-297abb13d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aedc233-83cb-4915-b490-297abb13d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b690ae3a-5791-4316-a6eb-865a1d5755a1', 'volume_name': 'volume-b690ae3a-5791-4316-a6eb-865a1d5755a1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f97a55-1b5e-45c6-a370-a1adcf2a13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f97a55-1b5e-45c6-a370-a1adcf2a13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a7954d-ab4f-4ee6-a0a0-414cc6bbc8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:57 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Volume b690ae3a-5791-4316-a6eb-865a1d5755a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b690ae3a-5791-4316-a6eb-865a1d5755a1', 'volume_size': 1} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422321577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b690ae3a-5791-4316-a6eb-865a1d5755a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:09:57Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Creating volume b690ae3a-5791-4316-a6eb-865a1d5755a1 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:09:57 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:57 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 1073741824 Aug 28 09:09:57 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:57 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 1073741824" returned: 0 in 0.403s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:57 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:57 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 Aug 28 09:09:57 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:58 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1" returned: 0 in 0.240s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a7954d-ab4f-4ee6-a0a0-414cc6bbc8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b690ae3a-5791-4316-a6eb-865a1d5755a1', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5088a65-360a-428a-a1f0-82cdd927df01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:09:58 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Volume volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 (b690ae3a-5791-4316-a6eb-865a1d5755a1): created successfully Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5088a65-360a-428a-a1f0-82cdd927df01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (3a8022d1-673e-4a55-8793-c9476c860eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:09:58 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-4a965898-0c4a-487e-bcae-4dbaec05c428 tempest-ProjectReaderTests-878221051 None] Created volume successfully. Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-b690ae3a-5791-4316-a6eb-865a1d5755a1-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "cinder-b690ae3a-5791-4316-a6eb-865a1d5755a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-quobyte-b690ae3a-5791-4316-a6eb-865a1d5755a1" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-b690ae3a-5791-4316-a6eb-865a1d5755a1" acquired by "delete_volume" :: waited 0.012s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc730642-4665-4ea4-95b3-d15ca805d62b]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:58 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 Aug 28 09:09:58 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:58 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1" returned: 0 in 0.338s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:58 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:58 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1 Aug 28 09:09:58 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:59 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-b690ae3a-5791-4316-a6eb-865a1d5755a1" returned: 0 in 0.234s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-b690ae3a-5791-4316-a6eb-865a1d5755a1" released by "delete_volume" :: held 0.611s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Created reservations ['544428d8-ad41-4675-88ce-f5b2e13428b5', 'ba8c3d31-128a-4f64-a417-49202e07a2c5', '071d2fbf-c8a6-4d5c-ad6f-e5da3a3dde07', '680f6aef-f677-4aa6-8a38-d815a1ecfe5e'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:09:59 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:09:59 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:09:59 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.247s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:09:59 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Deleted volume successfully. Aug 28 09:09:59 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-360f2022-82f8-4c1b-a37e-8d7d57cdade4 tempest-ProjectReaderTests-878221051 None] Lock "cinder-b690ae3a-5791-4316-a6eb-865a1d5755a1-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (bf0a1a33-4aa2-4933-b51b-776c9aa997d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaed819-c1f1-4782-9538-ec5c74f9b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaed819-c1f1-4782-9538-ec5c74f9b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085185671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e9e050-7cea-4b7c-a5be-726dfbb537a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:10:00Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b5f3d1-f9e3-4184-a83c-3dad23273266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b5f3d1-f9e3-4184-a83c-3dad23273266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c39c8a1-94ea-43c3-a135-2647e6bf4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c39c8a1-94ea-43c3-a135-2647e6bf4472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e9e050-7cea-4b7c-a5be-726dfbb537a0', 'volume_name': 'volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672e38f1-74eb-4f7f-8565-4f3d6db103fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672e38f1-74eb-4f7f-8565-4f3d6db103fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74541bee-ad46-4b1e-b3a6-adb220a1f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Volume 10e9e050-7cea-4b7c-a5be-726dfbb537a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0', 'volume_size': 1} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085185671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e9e050-7cea-4b7c-a5be-726dfbb537a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:10:00Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Creating volume 10e9e050-7cea-4b7c-a5be-726dfbb537a0 {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:10:00 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:00 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 1073741824 Aug 28 09:10:00 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:00 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 1073741824" returned: 0 in 0.378s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:00 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 Aug 28 09:10:00 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:00 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0" returned: 0 in 0.233s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74541bee-ad46-4b1e-b3a6-adb220a1f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3f2282-5f48-45ea-b56d-f71f2dfe139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:00 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Volume volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 (10e9e050-7cea-4b7c-a5be-726dfbb537a0): created successfully Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3f2282-5f48-45ea-b56d-f71f2dfe139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:00 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (bf0a1a33-4aa2-4933-b51b-776c9aa997d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:10:00 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-ce4300ed-69df-48dc-819c-041a3aba2683 tempest-ProjectReaderTests-878221051 None] Created volume successfully. Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-10e9e050-7cea-4b7c-a5be-726dfbb537a0-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "cinder-10e9e050-7cea-4b7c-a5be-726dfbb537a0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-quobyte-10e9e050-7cea-4b7c-a5be-726dfbb537a0" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-10e9e050-7cea-4b7c-a5be-726dfbb537a0" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d5d50-bd19-4768-a464-b193244a31ec]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:01 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 Aug 28 09:10:01 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:01 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0" returned: 0 in 0.337s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:01 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0 Aug 28 09:10:01 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:01 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-10e9e050-7cea-4b7c-a5be-726dfbb537a0" returned: 0 in 0.229s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-10e9e050-7cea-4b7c-a5be-726dfbb537a0" released by "delete_volume" :: held 0.601s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Created reservations ['7c449f31-3709-41d7-9dc1-b117c20012d7', 'b4adddf4-6237-45b6-82aa-276fed3694f4', 'a513bc92-bb15-40b3-96b9-a26214080b89', '86dd76bb-d035-41e6-8942-7e279584d8b9'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:01 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:01 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:10:01 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:02 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.231s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:10:02 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Deleted volume successfully. Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-a21d5f34-5ec0-4e44-83f5-6f88f135d57e tempest-ProjectReaderTests-878221051 None] Lock "cinder-10e9e050-7cea-4b7c-a5be-726dfbb537a0-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85762) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (c55e6145-8752-4881-a031-ffa6e0e79277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bc6f0f-7598-4cd7-9f79-0a377132c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bc6f0f-7598-4cd7-9f79-0a377132c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839310292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dd4640-be59-41cb-a70f-31ea477d206c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:10:03Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e92c02d-7652-4684-8977-df521256039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e92c02d-7652-4684-8977-df521256039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633b7f73-9509-4d38-b8ad-f05b35394a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633b7f73-9509-4d38-b8ad-f05b35394a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dd4640-be59-41cb-a70f-31ea477d206c', 'volume_name': 'volume-53dd4640-be59-41cb-a70f-31ea477d206c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bc78a9-b9a7-44ef-bced-58494eaf97ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bc78a9-b9a7-44ef-bced-58494eaf97ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47bb3bf-cbf8-4c19-9356-1d9b2bb9e70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:02 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Volume 53dd4640-be59-41cb-a70f-31ea477d206c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dd4640-be59-41cb-a70f-31ea477d206c', 'volume_size': 1} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839310292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dd4640-be59-41cb-a70f-31ea477d206c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85b2ab9c93e4bb69724c7d071d869a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:10:03Z,use_quota=True,user_id='684b5f4d91924d9ab66142129689d484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e515ee8-f9d2-4ca1-bc81-69feb989e1d0),volume_type_id=9e515ee8-f9d2-4ca1-bc81-69feb989e1d0)}" {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.remotefs [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Creating volume 53dd4640-be59-41cb-a70f-31ea477d206c {{(pid=85762) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Selected osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 as target Quobyte volume. {{(pid=85762) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:10:02 devstack cinder-volume[85762]: INFO cinder.volume.drivers.remotefs [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] casted to osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6 Aug 28 09:10:02 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c 1073741824 {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:02 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c 1073741824 Aug 28 09:10:02 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:03 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c 1073741824" returned: 0 in 0.399s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:03 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c Aug 28 09:10:03 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:03 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c" returned: 0 in 0.233s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'} {{(pid=85762) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47bb3bf-cbf8-4c19-9356-1d9b2bb9e70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dd4640-be59-41cb-a70f-31ea477d206c', 'volume_size': 1}' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235fc06-b878-4118-af4d-c820161f4324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:10:03 devstack cinder-volume[85762]: INFO cinder.volume.flows.manager.create_volume [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Volume volume-53dd4640-be59-41cb-a70f-31ea477d206c (53dd4640-be59-41cb-a70f-31ea477d206c): created successfully Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235fc06-b878-4118-af4d-c820161f4324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85762) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Flow 'volume_create_manager' (c55e6145-8752-4881-a031-ffa6e0e79277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85762) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:10:03 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-8a3136eb-bde9-4b09-afab-211772c136b9 tempest-ProjectReaderTests-878221051 None] Created volume successfully. Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-53dd4640-be59-41cb-a70f-31ea477d206c-delete_volume" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "cinder-53dd4640-be59-41cb-a70f-31ea477d206c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Acquiring lock "cinder-quobyte-53dd4640-be59-41cb-a70f-31ea477d206c" by "delete_volume" {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-53dd4640-be59-41cb-a70f-31ea477d206c" acquired by "delete_volume" :: waited 0.016s {{(pid=85762) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d01b6-14af-422a-a6cf-de06d7e4427f]: (4, 'qcow2') {{(pid=87477) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:10:03 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:03 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c Aug 28 09:10:03 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:04 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c" returned: 0 in 0.374s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:04 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c Aug 28 09:10:04 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:04 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b/volume-53dd4640-be59-41cb-a70f-31ea477d206c" returned: 0 in 0.232s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "cinder-quobyte-53dd4640-be59-41cb-a70f-31ea477d206c" released by "delete_volume" :: held 0.642s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.quota [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Created reservations ['ef53169e-789c-41cd-9f87-39c6664cda8b', '65e86218-93c5-4189-af8c-3005115654c4', 'e28028dd-ecdb-4e37-81b8-d4627999693b', '2652e135-9dc6-44ab-a079-c3043fbb8a99'] {{(pid=85762) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6': None} {{(pid=85762) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.volume.drivers.quobyte [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f4995bb1-bbe6-4a43-9e5c-984fe7b70fa6'] {{(pid=85762) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.lockutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85762) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:10:04 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b Aug 28 09:10:04 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:10:04 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG oslo_concurrency.processutils [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/165518590158c27583f60773e828e93b" returned: 0 in 0.232s {{(pid=85762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.manager [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Notifying Schedulers of capabilities ... {{(pid=85762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:10:04 devstack cinder-volume[85762]: INFO cinder.volume.manager [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Deleted volume successfully. Aug 28 09:10:04 devstack cinder-volume[85762]: DEBUG cinder.coordination [None req-5eb09f20-3b69-4d0d-a782-3f166be252bd tempest-ProjectReaderTests-878221051 None] Lock "cinder-53dd4640-be59-41cb-a70f-31ea477d206c-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=85762) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:10:14 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=145,cinder:SELECT=102,cinder:INSERT=39,cinder:DELETE=12 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:10:14 devstack cinder-volume[85762]: DEBUG dbcounter [-] [85762] Writing DB stats cinder:UPDATE=143,cinder:SELECT=103,cinder:INSERT=34,cinder:DELETE=11 {{(pid=85762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}